-- Logs begin at Wed 2021-12-08 10:52:00 UTC, end at Wed 2021-12-08 11:57:37 UTC. -- Dec 08 11:22:58.169639 dv-cinder-819778-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 08 11:22:58.178869 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 8 11:22:58 2021] *** Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: nodename: dv-cinder-819778-3-iscsi Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: machine: x86_64 Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: clock source: unix Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: pcre jit disabled Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: detected number of CPU cores: 4 Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: current working directory: / Dec 08 11:22:58.180805 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: detected binary path: /usr/bin/uwsgi-core Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: your processes number limit is 47680 Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: your memory page size is 4096 bytes Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: detected max file descriptor number: 2048 Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: lock engine: pthread robust mutexes Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: thunder lock: enabled Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 08 11:22:58.181596 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 08 11:22:58.225378 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: Python main interpreter initialized at 0x56236c8089c0 Dec 08 11:22:58.225378 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: python threads support enabled Dec 08 11:22:58.225378 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: your server socket listen backlog is limited to 100 connections Dec 08 11:22:58.225378 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: your mercy for graceful operations on workers is 90 seconds Dec 08 11:22:58.225709 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: mapped 403077 bytes (393 KB) for 2 cores Dec 08 11:22:58.225785 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: *** Operational MODE: preforking *** Dec 08 11:22:58.226041 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: *** uWSGI is running in multiple interpreter mode *** Dec 08 11:22:58.226041 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: spawned uWSGI master process (pid: 101590) Dec 08 11:22:58.226235 dv-cinder-819778-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 08 11:22:58.226784 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: spawned uWSGI worker 1 (pid: 101591, cores: 1) Dec 08 11:22:58.227123 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: spawned uWSGI worker 2 (pid: 101592, cores: 1) Dec 08 11:22:58.227391 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 08 11:22:59.934520 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:22:59.934520 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: from cryptography.utils import int_from_bytes Dec 08 11:22:59.935186 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:22:59.935186 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: from cryptography.utils import int_from_bytes Dec 08 11:22:59.939573 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:22:59.939573 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: from cryptography.utils import int_from_bytes Dec 08 11:22:59.940035 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:22:59.940035 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: from cryptography.utils import int_from_bytes Dec 08 11:23:02.519039 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:23:02.519562 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:23:02.519656 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:23:02.520031 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:23:02.520118 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:23:02.520195 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:23:02.520268 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:23:02.520340 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:23:02.520878 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.520978 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:23:02.521168 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:23:02.521268 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.521535 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.521626 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.521854 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.521999 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.522177 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.522276 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.522484 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.522581 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.522801 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.522899 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.523123 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.523214 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.523449 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.523539 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.523705 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.523797 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524016 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524107 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524332 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-3-iscsi {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524422 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524650 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524740 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.524950 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525042 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-3-iscsi {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525282 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525388 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525597 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525687 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525898 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.525990 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.526217 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.526314 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.526520 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.526605 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.526843 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.527012 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.527156 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.527472 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.527668 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.527770 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.527983 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.528059 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.528294 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.528384 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.528611 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.528718 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.528949 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.529060 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.529294 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.529399 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.529598 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.529698 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.529917 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530024 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530224 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530318 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530548 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530653 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-3-iscsi {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530862 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.530957 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.531219 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.531312 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-3-iscsi {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.531528 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.531631 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.531866 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.531979 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.532183 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.532305 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.532518 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.532695 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.532834 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.532933 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.533174 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.533274 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.533484 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.533580 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.533808 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.534410 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.534668 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.534806 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.534978 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535066 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535295 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535383 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535596 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535688 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535903 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.535989 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.536209 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.536295 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.536525 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.536623 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.536829 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.536921 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.537132 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.537301 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.537392 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.537478 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.537706 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.537846 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538007 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538091 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538322 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538407 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538638 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538735 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538888 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.538985 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.539134 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.539280 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.539448 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.539536 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.539764 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.539856 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540070 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540164 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540377 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540467 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540682 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540774 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.540985 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.541083 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.541315 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.541412 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.541621 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.541713 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.541926 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542020 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542235 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542363 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542543 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542639 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542851 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.542958 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.543170 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.543263 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.543478 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.543577 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.543793 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.543895 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.544102 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.544200 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.544418 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.544510 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.544727 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.544836 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.545057 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.545181 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.545393 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.545494 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.545698 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.545794 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546013 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546098 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546328 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546421 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546632 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546717 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.546936 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547027 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547238 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547330 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547550 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547639 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547866 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.547979 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.548167 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.548265 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.548414 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.548506 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.548709 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.548814 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.549009 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.549108 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.549347 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.549443 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.550210 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.550315 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.550527 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.550629 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.550830 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.550922 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.551130 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.551216 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.551433 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.551533 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.551737 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.551827 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552038 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552121 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552345 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552465 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552646 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552738 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.552944 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553029 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553267 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553357 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553573 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553656 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553872 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.553965 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.554178 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.554263 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.554487 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.554572 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.554788 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.554872 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555092 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555253 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555390 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555530 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555671 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555814 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.555986 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.556121 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.556289 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.556430 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.556576 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.556716 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.556891 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557037 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557211 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557356 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557516 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557657 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557829 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.557970 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.558130 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.558261 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.558434 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.558570 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.558782 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.558931 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559064 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559199 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559331 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559464 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559606 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559738 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.559912 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560047 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560215 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560358 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560502 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560633 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560802 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.560945 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.561086 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.561275 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.561412 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.561505 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.561711 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.561796 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562008 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562102 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562305 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562415 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562619 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562715 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.562921 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563014 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563223 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563316 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563531 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563616 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563833 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.563920 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.564140 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.564230 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.564449 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.564542 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.564773 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:02.564867 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.565109 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.565212 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.565463 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.565573 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.565795 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.565892 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.566120 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.566206 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.566435 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.566528 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.566745 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.566837 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567056 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567142 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567377 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567474 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567684 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567775 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.567991 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.568114 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.568299 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.568394 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.568609 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.568694 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.568922 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569005 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569269 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569378 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569585 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569696 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569899 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.569987 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.570213 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.570310 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.570520 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.570652 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.570836 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.570922 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.571148 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.571245 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.571467 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.571551 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.571773 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.571866 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.572107 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.572193 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.572425 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.572510 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.572734 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.572822 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.573054 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.573142 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.573384 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.573472 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.573706 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.573799 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574015 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574101 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574321 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574407 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574630 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574724 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.574953 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575045 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575262 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575349 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575570 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575668 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575896 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.575980 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.576206 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.576291 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.576518 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.576615 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.576817 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.576910 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.577120 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.577250 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.577443 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.577542 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.577749 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.577836 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578049 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578135 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578365 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578467 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578670 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578763 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.578971 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579055 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579298 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579428 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579600 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579692 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579903 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.579989 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.580207 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.580294 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.580508 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.580595 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.581355 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.581454 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.581662 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.581752 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.581964 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582051 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582276 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582362 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582580 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582673 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582880 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.582967 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.583197 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.583294 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.583498 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.583585 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.583798 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.583884 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.584113 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.584207 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.584420 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.584503 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.584725 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.584810 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585032 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585125 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585371 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585456 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585679 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585774 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.585984 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.586083 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.586305 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.586389 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.586619 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.586704 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.586918 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587004 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587238 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587369 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587555 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587665 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587862 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.587950 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.588161 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.588248 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.588466 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.588556 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.588766 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.588854 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589065 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589181 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589388 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589513 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589693 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589780 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.589989 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590082 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590287 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590382 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590586 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590673 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590886 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.590972 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.591186 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.591284 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.591492 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.591582 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.591792 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.591877 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592090 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592193 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592388 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592481 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592688 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592780 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.592999 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.593095 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.593333 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.593421 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.593666 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.593764 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.593978 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.594071 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.594300 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.594384 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.594616 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.594708 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.594925 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595013 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595234 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595326 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595540 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595627 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595848 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.595935 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.596155 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.596241 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597006 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597133 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597355 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597461 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597667 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597753 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.597986 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.598072 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.598294 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.598383 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.598614 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.598701 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.598919 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599012 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599236 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599374 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599539 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599676 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599850 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.599945 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.600162 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.600254 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.600482 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.600568 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.600804 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.600896 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.601123 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.601234 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.601453 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.601539 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.601763 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.601862 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602068 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602155 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602374 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602457 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602679 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602767 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.602985 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.603070 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.603297 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.603381 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.603601 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.603686 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.603918 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604001 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604221 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604305 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604539 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604630 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604845 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.604938 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.605176 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.605265 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.605475 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.605562 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.605786 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.605879 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.606095 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.606183 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.606416 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.606503 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.606721 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.606813 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607030 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607128 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607346 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607439 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607654 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607744 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.607960 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608055 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608266 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608351 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608567 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608651 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608866 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.608960 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.609192 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.609281 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.609506 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.609590 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.609809 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.609956 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.610114 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.610244 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.610414 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.610545 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.610761 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.610905 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611039 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611179 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611320 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611467 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611607 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611741 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.611877 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.612033 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.612240 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.612376 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.612557 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.612693 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.612884 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613028 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613226 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613376 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613548 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613683 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613849 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.613991 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.614170 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.614312 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.614474 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.614608 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.614776 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.614917 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615078 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615226 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615376 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615510 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615689 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615823 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.615998 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.616142 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.616299 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.616434 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.616612 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.616747 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.616927 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617077 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617254 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617396 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617565 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617700 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617871 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.617960 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.618177 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.618264 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.618494 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.618581 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.618803 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.618893 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.619108 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.619201 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.619413 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.619499 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.619780 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.619879 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620022 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620108 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620329 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620415 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620642 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620728 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.620945 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.621029 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.621277 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.621433 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.621570 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.621704 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.621873 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.622009 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.622179 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.622326 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.622483 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.622617 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.622798 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.623040 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.623176 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.623371 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.623671 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.623807 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.623990 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.624124 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.624307 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.624450 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.624623 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.624759 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.624946 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.625079 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.625326 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.625463 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.625632 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.625768 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.625963 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.626105 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.626270 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.626406 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.626573 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.626709 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.626874 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627008 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627181 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627317 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627482 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627628 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627808 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.627942 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.628111 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.628247 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.628416 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.628558 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.628718 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.628866 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629012 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629164 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629354 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629493 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629658 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629805 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.629968 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630065 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630258 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630344 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630565 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630661 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630866 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.630953 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.631182 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.631319 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.631486 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.631573 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.631786 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.631873 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.632084 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.632172 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.632384 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.632469 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.632713 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.632811 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.633011 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.633103 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.633366 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.633456 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.633681 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.633774 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634021 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634106 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634323 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634409 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634625 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634784 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.634947 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635034 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635250 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635336 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635551 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635637 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635850 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.635943 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.636155 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.636247 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.636458 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.636545 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.636755 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.636840 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637060 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637163 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637390 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637477 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637693 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637780 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.637996 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638081 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638293 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638380 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638597 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638689 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638899 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.638995 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.639205 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.639290 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.639508 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.639593 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.639805 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.639898 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.640104 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.640242 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.640407 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.640538 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.640710 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.640849 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641007 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641139 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641337 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641472 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641612 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641753 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.641918 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642053 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642217 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642349 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642517 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642653 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642816 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.642950 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.643120 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.643763 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.643952 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.644090 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.644259 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.644400 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.644569 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.644702 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.644872 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.645007 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.645197 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.645343 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.645487 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.645875 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.646045 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.646184 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.646345 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.646476 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.646665 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.646961 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.647103 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.647268 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.647401 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.647581 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.647716 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.647891 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.648043 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.648181 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.648323 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.648507 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.648784 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.648928 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.649094 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.649262 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.649418 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.649554 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.649717 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.649861 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650022 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650184 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650342 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650498 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650636 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650779 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.650913 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651045 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651177 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651309 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651447 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651586 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651761 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.651897 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652065 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652226 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652368 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652507 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652639 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652779 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.652932 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.653069 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.653292 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.653427 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.653589 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.653719 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.653944 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654093 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654254 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654390 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654531 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654665 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654848 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.654988 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.655156 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.655286 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.655462 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.655551 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.655796 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.655955 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656093 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656250 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656388 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656522 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656656 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656803 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.656944 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657075 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657262 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657399 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657533 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657674 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657853 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.657988 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.658142 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.658285 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.658454 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.658591 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.658770 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.658995 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.659620 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.659705 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.659938 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660027 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660239 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660325 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660547 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660659 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660856 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.660944 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.661173 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.661263 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.661485 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.661572 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.661789 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.661878 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.662096 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.662189 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.662403 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.662498 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.662708 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.662802 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663012 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663099 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663318 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663418 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663615 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663702 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.663920 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664013 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664223 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664386 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664529 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664615 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664846 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.664931 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.665168 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.665271 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.665477 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.665564 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.665783 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.665922 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.666085 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.666177 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.666394 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.666482 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.666696 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.666781 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.667112 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.667199 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.667423 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.667518 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.667733 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.667819 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668036 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668160 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668343 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668429 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668650 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668736 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.668961 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.669048 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.669297 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.669388 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.669605 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.669705 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670019 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670106 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670328 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670413 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670638 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670732 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.670943 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671029 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671243 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671329 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671545 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671640 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671850 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.671936 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.672171 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.672256 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.672471 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.672565 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.672772 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.672888 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.673070 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.673186 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.673415 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.673502 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.673716 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.673810 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.674035 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.674122 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.674453 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.674566 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.674785 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.674872 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.675088 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.675181 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.675496 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.675590 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.675804 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.675891 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.676109 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.676207 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.676427 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.676513 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.676745 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.676838 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.677066 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.677183 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.677392 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.677486 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.677703 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.677789 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678009 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678108 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678331 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678481 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678649 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678791 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.678957 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.679098 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.679267 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.679403 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.679568 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.679704 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.679884 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680026 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680203 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680341 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680513 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680603 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680832 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.680920 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.681267 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.681357 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.681588 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.681696 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.681895 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.681990 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.682210 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.682298 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.682530 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.682616 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.682832 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.682918 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.683134 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.683222 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.683440 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.683526 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.683741 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.683834 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684043 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684136 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684364 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684450 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684668 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684753 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.684975 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685063 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685306 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685395 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685611 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685709 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685912 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.685998 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.686210 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.686296 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.686529 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.686624 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.686829 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.686914 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.687147 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.687234 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.687458 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.687558 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.687775 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.687869 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.688094 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.688179 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.688396 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.688493 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.688713 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.688802 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689021 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689107 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689347 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689436 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689649 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689735 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.689951 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.690093 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.690313 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.690457 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.690603 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.690740 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.690919 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.691054 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.691247 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.691389 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.691569 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.691707 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.691874 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692016 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692204 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692341 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692526 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692664 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692837 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.692980 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.693221 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.693363 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.693499 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.693645 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.693782 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.693925 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694060 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694195 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694356 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694506 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694642 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694786 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.694927 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695068 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695215 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695356 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695525 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695671 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695814 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.695949 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696082 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696165 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696376 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696471 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696693 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696781 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.696993 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.697116 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.697335 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.697424 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.697642 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.697729 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.697945 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.698038 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.698245 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.698333 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.698545 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.698680 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.698882 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699021 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699184 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699319 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699510 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699645 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699822 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.699920 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.700141 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.700285 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.700462 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.700570 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.700765 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.700905 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.701085 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.701239 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.701435 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.701575 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.701746 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.701885 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702059 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702192 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702372 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702504 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702683 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702824 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.702994 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.703127 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.703304 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.703436 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.703613 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.703916 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.704047 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.704236 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.704367 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.704557 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.704698 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.704950 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.705081 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.705427 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.706319 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.706436 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.706568 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.706658 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.706881 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.706973 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.707193 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.707279 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.707504 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.707597 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.707817 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.707902 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.708126 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.708219 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.708435 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.708536 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.708743 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.708838 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.709052 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.709175 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.709384 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.709472 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.709709 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.709795 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710032 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710198 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710342 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710473 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710670 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710803 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.710982 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.711124 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.711296 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.711432 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.711608 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.711740 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.711919 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.712054 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.712260 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.712395 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.712572 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.712715 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.712877 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713028 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713209 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713363 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713527 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713691 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713832 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.713964 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.714133 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.714269 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.714440 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.714576 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.714749 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.714884 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715062 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715197 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715367 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715503 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715672 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715804 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.715980 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.716115 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.716286 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.716422 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.716605 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.716744 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.716934 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.717080 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.717271 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.717404 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.717581 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.717719 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.717891 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.718103 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.718239 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.718430 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.718704 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.718837 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719017 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719163 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719344 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719481 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719666 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719807 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.719989 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.720092 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.720301 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.720390 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.720613 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.720701 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.720934 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.721029 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.721278 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.721386 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.722137 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.722255 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.722450 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.722592 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.722803 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.722916 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.723107 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.723237 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.723424 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.723537 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.723730 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.723820 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.724031 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.724118 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.724348 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.724580 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.724666 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.724933 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.725191 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.725298 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.725537 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.725624 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.725850 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.725943 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.726173 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.726270 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.726496 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.726627 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.726811 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.726905 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.727116 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.727211 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.727433 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.727518 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.727734 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.727820 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728036 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728123 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728346 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728434 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728653 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728739 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.728953 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729040 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729281 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729371 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729591 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729677 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729898 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.729992 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.730197 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.730329 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.730504 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.730591 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.730803 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.730927 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.731126 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.731218 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.731428 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.731530 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.731731 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.731817 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732031 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732117 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732337 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732430 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732635 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732720 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.732934 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733022 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733260 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733528 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733634 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733724 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733857 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.733945 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.734158 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.734257 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.734462 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.734549 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.734762 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.734858 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735074 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735168 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735374 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735468 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735682 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735770 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.735982 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736080 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736287 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736372 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736592 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736723 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736893 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.736999 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.737265 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.737367 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.737578 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.737665 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.737891 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.737985 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.738199 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.738284 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.738505 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.738592 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.738847 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.739070 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.739159 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.739454 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.739671 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.739765 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.740051 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.740144 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.740372 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.740459 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.740710 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.740869 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.741057 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.741199 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.741394 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.741488 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.741701 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.741803 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742009 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742104 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742326 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742411 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742634 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742728 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.742945 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743038 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743252 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743348 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743557 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743644 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743864 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.743956 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.744169 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.744269 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.744480 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.744632 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.744775 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.744912 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.745087 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.745284 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.745423 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.745520 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.745758 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.745846 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.746074 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.746171 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.746390 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.746478 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.746704 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.746844 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747017 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747118 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747326 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747418 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747635 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747721 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.747942 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748105 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748248 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748336 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748561 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748647 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748876 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.748958 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.749212 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.749326 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.749518 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.749644 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.749931 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750026 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750239 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750327 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750553 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750640 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750871 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.750967 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.751177 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.751263 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.751494 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.751593 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.751813 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.751901 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.752121 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.752208 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.752437 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.752532 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.752767 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.752855 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.753093 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.753224 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.753477 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.753576 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.753789 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.753878 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.754100 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.754186 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.754409 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.754504 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.754717 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.754805 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755025 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755116 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755330 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755419 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755655 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755751 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.755985 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.756079 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.756296 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.756391 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.756615 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.756708 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.756922 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757017 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757260 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757351 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757569 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757659 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757886 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.757981 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.758198 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.758284 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.758506 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.758592 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.758810 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.758905 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.759131 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.759216 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.759434 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.759520 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.759740 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.759835 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760045 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760140 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760351 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760437 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760656 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760744 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.760959 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.761059 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.761303 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.761394 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.761627 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.761716 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.761930 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762018 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762249 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762338 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762562 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762651 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762877 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.762963 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.763185 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.763279 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.763492 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.763579 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.763815 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.763914 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.764122 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.764217 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.764431 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.764518 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.764736 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.764822 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.765047 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.765142 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.765382 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.765469 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.765695 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.765804 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766019 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766125 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766338 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766426 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766660 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766759 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.766982 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.767071 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.767323 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.767415 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.767633 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.767720 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.767956 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.768043 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.768801 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.768897 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.769181 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.769288 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.769385 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:23:02.769467 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.769734 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:02.769974 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:23:02.793209 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:02.794968 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_db.sqlalchemy.engines [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:02.857976 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.context [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7033496-1996-4048-927c-ede6e1628ed2(cell1) {{(pid=101592) load_cells /opt/stack/nova/nova/context.py:464}} Dec 08 11:23:02.860376 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.context [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7033496-1996-4048-927c-ede6e1628ed2(cell1) {{(pid=101591) load_cells /opt/stack/nova/nova/context.py:464}} Dec 08 11:23:02.862164 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_concurrency.lockutils [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:23:02.863749 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_concurrency.lockutils [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:23:02.864545 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:23:02.864646 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_concurrency.lockutils [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:23:02.866193 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:23:02.866544 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_concurrency.lockutils [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:23:02.867010 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:23:02.869068 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:23:02.877050 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:02.879724 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:02.883917 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_db.sqlalchemy.engines [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:02.887064 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_db.sqlalchemy.engines [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:03.047134 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:03.051615 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_db.sqlalchemy.engines [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:03.390656 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: WARNING keystonemiddleware.auth_token [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:23:03.396015 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: WARNING keystonemiddleware.auth_token [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:23:03.398063 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: WARNING keystonemiddleware.auth_token [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:23:03.402654 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: WARNING keystonemiddleware.auth_token [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:23:03.735468 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: WARNING keystonemiddleware.auth_token [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:23:03.740872 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: WARNING keystonemiddleware.auth_token [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:23:03.745976 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56236c8089c0 pid: 101592 (default app) Dec 08 11:23:03.746638 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: WARNING keystonemiddleware.auth_token [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:23:03.748049 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:23:03.749218 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Dec 08 11:23:03.749625 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Wed Dec 8 11:23:03 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:23:03.752026 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: WARNING keystonemiddleware.auth_token [None req-d06dc17b-1639-4abd-8946-83ae84e7810a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:23:03.757756 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56236c8089c0 pid: 101591 (default app) Dec 08 11:24:25.853271 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:25.854253 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 08 11:24:25.854837 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:26.282783 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-cbd6e5b4-1a32-4b7e-8d34-cf9ed97e6cae admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:26.314223 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-cbd6e5b4-1a32-4b7e-8d34-cf9ed97e6cae admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452049 Dec 08 11:24:26.314976 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Dec 8 11:24:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:28.715744 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:28.716661 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-e3ce3600-5ddb-4761-94b5-c5a2e6c2521a None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001377 Dec 08 11:24:28.726806 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:28 2021] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:28.791705 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-78e0f6ba-cf55-4533-bec7-dac66d1cb050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:28.809614 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:24:28.809614 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: warnings.warn(msg) Dec 08 11:24:28.837957 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-78e0f6ba-cf55-4533-bec7-dac66d1cb050 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110429 Dec 08 11:24:28.838517 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:28 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:29.102844 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-e7c23cf8-112a-492f-9263-f379ed196e62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:29.105206 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:24:29.105206 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: warnings.warn(msg) Dec 08 11:24:29.154636 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-e7c23cf8-112a-492f-9263-f379ed196e62 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306711 Dec 08 11:24:29.156193 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Dec 8 11:24:28 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:31.577261 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-78e0f6ba-cf55-4533-bec7-dac66d1cb050 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:31.578269 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-78e0f6ba-cf55-4533-bec7-dac66d1cb050 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Dec 08 11:24:31.578668 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:31.707029 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-1ab79032-4a45-46b6-a22c-f5856e3bf087 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:31.728084 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:24:31.728084 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: warnings.warn(msg) Dec 08 11:24:31.750577 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-1ab79032-4a45-46b6-a22c-f5856e3bf087 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165281 Dec 08 11:24:31.751510 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:24:31.763531 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-c7f2cf8d-6f37-475e-b74d-c899cbf13432 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:31.765050 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:24:31.765050 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: warnings.warn(msg) Dec 08 11:24:31.797935 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-c7f2cf8d-6f37-475e-b74d-c899cbf13432 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038049 Dec 08 11:24:31.798533 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Dec 8 11:24:31 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:34.206625 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-1ab79032-4a45-46b6-a22c-f5856e3bf087 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:34.207631 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-1ab79032-4a45-46b6-a22c-f5856e3bf087 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 08 11:24:34.209271 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:34.266666 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-fba4cd05-85ea-4fce-b8e2-42ff87678e48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:34.285424 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-fba4cd05-85ea-4fce-b8e2-42ff87678e48 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070991 Dec 08 11:24:34.286323 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:34.298903 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-98c50435-341d-4582-83a6-fc4a1e0f8bd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:34.322714 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-98c50435-341d-4582-83a6-fc4a1e0f8bd1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027790 Dec 08 11:24:34.323953 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Dec 8 11:24:34 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:36.732640 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-fba4cd05-85ea-4fce-b8e2-42ff87678e48 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:36.734265 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-fba4cd05-85ea-4fce-b8e2-42ff87678e48 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 Dec 08 11:24:36.734961 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:36.794773 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b28c4860-0e7b-490e-bfb7-879b8d0386cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "name": "ds2G"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:36.814349 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b28c4860-0e7b-490e-bfb7-879b8d0386cd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071558 Dec 08 11:24:36.814902 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:36.827316 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-439ca3cc-9d1f-4763-9dbf-e0f6e10bcae2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:36.850417 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-439ca3cc-9d1f-4763-9dbf-e0f6e10bcae2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027135 Dec 08 11:24:36.851002 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Dec 8 11:24:36 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:39.262091 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b28c4860-0e7b-490e-bfb7-879b8d0386cd admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:39.263083 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b28c4860-0e7b-490e-bfb7-879b8d0386cd admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 08 11:24:39.263486 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:39.322711 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-cb81596d-92b5-4253-a047-3005f365ff99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "swap": 0, "name": "ds4G"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:39.347414 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-cb81596d-92b5-4253-a047-3005f365ff99 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076589 Dec 08 11:24:39.348646 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:39.361378 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-6d457a48-fdf4-4c07-a4c7-2a1f76df2f2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:39.389107 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-6d457a48-fdf4-4c07-a4c7-2a1f76df2f2a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032077 Dec 08 11:24:39.390530 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Dec 8 11:24:39 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:24:41.848753 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-cb81596d-92b5-4253-a047-3005f365ff99 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:41.849842 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-cb81596d-92b5-4253-a047-3005f365ff99 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Dec 08 11:24:41.850300 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:41.920504 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-24386272-aa5c-4290-9308-6ecf22c1723b admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:41.943795 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-24386272-aa5c-4290-9308-6ecf22c1723b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086480 Dec 08 11:24:41.944301 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Dec 8 11:24:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:24:44.415966 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-cb81596d-92b5-4253-a047-3005f365ff99 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:44.417071 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-cb81596d-92b5-4253-a047-3005f365ff99 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Dec 08 11:24:44.417469 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:24:44.481695 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-67d0f792-b8b7-4c20-ae93-e19c4aee8493 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "ram": 512, "vcpus": 1}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:44.500685 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-67d0f792-b8b7-4c20-ae93-e19c4aee8493 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076804 Dec 08 11:24:44.501222 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:44 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:44.515677 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-e64701f7-78b4-44f9-bcf6-0cdeee233930 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:44.543906 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-e64701f7-78b4-44f9-bcf6-0cdeee233930 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033752 Dec 08 11:24:44.545228 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Dec 8 11:24:44 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:47.151981 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-67d0f792-b8b7-4c20-ae93-e19c4aee8493 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:47.153970 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-67d0f792-b8b7-4c20-ae93-e19c4aee8493 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Dec 08 11:24:47.154510 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:47.215620 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-86f13d70-f6fa-49e8-a8b8-346657d7f0d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:47.234815 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-86f13d70-f6fa-49e8-a8b8-346657d7f0d9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072628 Dec 08 11:24:47.235378 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:47.247432 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-6b791f59-d39d-4734-bc5e-31cde9055ce1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:47.270179 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-6b791f59-d39d-4734-bc5e-31cde9055ce1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026338 Dec 08 11:24:47.270747 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Dec 8 11:24:47 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:24:49.680198 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-86f13d70-f6fa-49e8-a8b8-346657d7f0d9 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:49.681292 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-86f13d70-f6fa-49e8-a8b8-346657d7f0d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Dec 08 11:24:49.681832 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:49.736615 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b4382bbf-f740-47dd-bfee-da2b5bd37c4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "vcpus": 2}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:49.754222 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b4382bbf-f740-47dd-bfee-da2b5bd37c4e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.066185 Dec 08 11:24:49.754787 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:49 2021] POST /compute/v2.1/flavors => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:24:49.767206 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-e254bea3-b6ff-4bbf-b2e2-22d86a2285f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:49.790069 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-e254bea3-b6ff-4bbf-b2e2-22d86a2285f3 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026620 Dec 08 11:24:49.790646 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Dec 8 11:24:49 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:52.197399 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b4382bbf-f740-47dd-bfee-da2b5bd37c4e admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:52.199068 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b4382bbf-f740-47dd-bfee-da2b5bd37c4e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Dec 08 11:24:52.205466 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:52 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:52.263988 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-11f9ac48-c0f7-46d0-bfc3-dffd2f96eb35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "ram": 8192, "name": "m1.large", "id": "4"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:52.283083 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-11f9ac48-c0f7-46d0-bfc3-dffd2f96eb35 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076558 Dec 08 11:24:52.283637 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:52.303781 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-fed92193-9898-47ab-80b3-0bf553a35d12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:52.331575 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-fed92193-9898-47ab-80b3-0bf553a35d12 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033713 Dec 08 11:24:52.332798 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Dec 8 11:24:52 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:24:54.841752 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-11f9ac48-c0f7-46d0-bfc3-dffd2f96eb35 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:24:54.843350 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-11f9ac48-c0f7-46d0-bfc3-dffd2f96eb35 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002573 Dec 08 11:24:54.845311 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:24:54 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:24:54.950713 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-032051fd-1235-4953-ae0f-666a606b0926 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "swap": 0, "name": "m1.xlarge", "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:54.972895 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-032051fd-1235-4953-ae0f-666a606b0926 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.122821 Dec 08 11:24:54.973695 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Dec 8 11:24:54 2021] POST /compute/v2.1/flavors => generated 408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:24:54.986334 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-30c5db21-2dbf-4bbe-a9ab-ce444563e539 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:24:55.010026 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-30c5db21-2dbf-4bbe-a9ab-ce444563e539 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027917 Dec 08 11:24:55.010970 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Dec 8 11:24:54 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:25:16.232773 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-032051fd-1235-4953-ae0f-666a606b0926 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:16.233807 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-032051fd-1235-4953-ae0f-666a606b0926 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Dec 08 11:25:16.234206 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:25:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:16.293521 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-8ac41a5b-5e0f-4b3c-9855-fa7d84663745 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:16.312555 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-8ac41a5b-5e0f-4b3c-9855-fa7d84663745 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071707 Dec 08 11:25:16.313131 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Dec 8 11:25:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:25:18.060137 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-032051fd-1235-4953-ae0f-666a606b0926 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:18.061120 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-032051fd-1235-4953-ae0f-666a606b0926 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Dec 08 11:25:18.061543 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:18.256756 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-03d54ad7-dceb-4ace-bf7f-3cdaa99b9077 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:18.262379 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.wsgi [None req-03d54ad7-dceb-4ace-bf7f-3cdaa99b9077 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 08 11:25:18.262960 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-03d54ad7-dceb-4ace-bf7f-3cdaa99b9077 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:25:18.263754 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-03d54ad7-dceb-4ace-bf7f-3cdaa99b9077 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059101 Dec 08 11:25:18.264270 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Dec 8 11:25:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 08 11:25:18.274135 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b54d9e4e-045b-4b64-ab33-d324ca444c0f admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:18.295541 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b54d9e4e-045b-4b64-ab33-d324ca444c0f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024883 Dec 08 11:25:18.296091 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Dec 8 11:25:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:25:18.305938 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-6d3939bd-81f2-44ec-8ea6-da2ee6d34b67 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:18.326924 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-6d3939bd-81f2-44ec-8ea6-da2ee6d34b67 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024429 Dec 08 11:25:18.327447 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Dec 8 11:25:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:25:18.337024 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-60241978-c2f0-4d2f-a381-ede97cc12230 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:18.343066 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.wsgi [None req-60241978-c2f0-4d2f-a381-ede97cc12230 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 08 11:25:18.343630 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-60241978-c2f0-4d2f-a381-ede97cc12230 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:25:18.344415 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-60241978-c2f0-4d2f-a381-ede97cc12230 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010876 Dec 08 11:25:18.344905 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Dec 8 11:25:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 08 11:25:19.838980 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-6d3939bd-81f2-44ec-8ea6-da2ee6d34b67 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:19.839997 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-6d3939bd-81f2-44ec-8ea6-da2ee6d34b67 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Dec 08 11:25:19.840374 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:20.033932 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-ef8fc0af-2ac3-427e-b2b6-b7923db92caf admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:20.039539 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.wsgi [None req-ef8fc0af-2ac3-427e-b2b6-b7923db92caf admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 08 11:25:20.040094 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-ef8fc0af-2ac3-427e-b2b6-b7923db92caf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:25:20.040874 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-ef8fc0af-2ac3-427e-b2b6-b7923db92caf admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058597 Dec 08 11:25:20.041408 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Dec 8 11:25:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 08 11:25:20.051090 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-56dfcb97-e4fa-4b90-89ea-bf393c627b13 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:20.064147 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-56dfcb97-e4fa-4b90-89ea-bf393c627b13 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016606 Dec 08 11:25:20.064668 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Dec 8 11:25:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:25:20.074197 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-bc5c212f-6346-4c09-942d-2c79061e60da admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:20.088049 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-bc5c212f-6346-4c09-942d-2c79061e60da admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017184 Dec 08 11:25:20.088730 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Dec 8 11:25:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:25:20.099227 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-ceac9ae0-8d38-49c8-8f76-107af3f79e9a admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:20.104500 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.wsgi [None req-ceac9ae0-8d38-49c8-8f76-107af3f79e9a admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 08 11:25:20.105059 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-ceac9ae0-8d38-49c8-8f76-107af3f79e9a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:25:20.105868 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-ceac9ae0-8d38-49c8-8f76-107af3f79e9a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010225 Dec 08 11:25:20.106393 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Dec 8 11:25:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 08 11:25:21.587047 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-bc5c212f-6346-4c09-942d-2c79061e60da admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:21.588052 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-bc5c212f-6346-4c09-942d-2c79061e60da admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Dec 08 11:25:21.588441 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:21.775417 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-032000b8-db9d-44c3-8627-52fc5acf2e4d admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:21.781162 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.wsgi [None req-032000b8-db9d-44c3-8627-52fc5acf2e4d admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 08 11:25:21.781731 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-032000b8-db9d-44c3-8627-52fc5acf2e4d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:25:21.782513 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-032000b8-db9d-44c3-8627-52fc5acf2e4d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056761 Dec 08 11:25:21.783020 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Dec 8 11:25:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 08 11:25:21.792839 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-ed2ed3e6-5b68-43f1-a66f-e094d96fc560 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:21.806522 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-ed2ed3e6-5b68-43f1-a66f-e094d96fc560 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017378 Dec 08 11:25:21.806998 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Dec 8 11:25:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:25:21.818158 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:21.830775 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017585 Dec 08 11:25:21.831289 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Dec 8 11:25:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:25:21.841357 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-19b54661-0f4a-47fe-aec0-6bb66e9e8efb admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:21.846383 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.wsgi [None req-19b54661-0f4a-47fe-aec0-6bb66e9e8efb admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 08 11:25:21.846934 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-19b54661-0f4a-47fe-aec0-6bb66e9e8efb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:25:21.847754 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-19b54661-0f4a-47fe-aec0-6bb66e9e8efb admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010435 Dec 08 11:25:21.848184 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Dec 8 11:25:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 08 11:25:23.361376 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:23.362417 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Dec 08 11:25:23.362810 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:23.555204 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-aa860c82-30c9-422c-a224-87c90d867c85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:25:23.573397 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-aa860c82-30c9-422c-a224-87c90d867c85 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070384 Dec 08 11:25:23.573937 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Dec 8 11:25:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:25:25.060799 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:25.061807 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Dec 08 11:25:25.062221 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:25.254369 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-be57de2a-228b-48ce-9c5b-6f976bad19fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:25:25.271855 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-be57de2a-228b-48ce-9c5b-6f976bad19fa admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067791 Dec 08 11:25:25.272608 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Dec 8 11:25:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:25:26.779308 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:26.780313 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 08 11:25:26.780705 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:25:26.973180 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-75ab641d-8840-429c-9737-163cf42dfc72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:25:26.990294 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-75ab641d-8840-429c-9737-163cf42dfc72 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068397 Dec 08 11:25:26.990906 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Dec 8 11:25:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:25:28.494408 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:28.495410 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Dec 08 11:25:28.495808 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:28.689395 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-16700f34-3700-49e7-a01a-cdfdccb3ba6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:25:28.706938 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-16700f34-3700-49e7-a01a-cdfdccb3ba6a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069610 Dec 08 11:25:28.707412 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Dec 8 11:25:28 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:25:30.196598 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:30.197622 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Dec 08 11:25:30.198018 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:25:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:25:30.387828 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-35d7403f-8039-42de-84af-76c732d1f649 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:25:30.407346 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-35d7403f-8039-42de-84af-76c732d1f649 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069899 Dec 08 11:25:30.407814 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Wed Dec 8 11:25:30 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:26:17.997014 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:26:17.998073 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-109e8c88-aa0b-47ce-99b4-d3abace4846e admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 08 11:26:17.998491 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Wed Dec 8 11:26:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:26:18.055135 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-e4026dba-110b-4680-a4ad-81761570267e admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:26:18.073650 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-e4026dba-110b-4680-a4ad-81761570267e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068734 Dec 08 11:26:18.074179 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Dec 8 11:26:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:26:18.096810 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-b34e50ce-8b71-412e-a231-ccbe045157c5 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:26:18.104407 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-b34e50ce-8b71-412e-a231-ccbe045157c5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011161 Dec 08 11:26:18.104926 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Wed Dec 8 11:26:18 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:26:18.116537 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-8dc1333a-c3ae-4967-b559-30386962db87 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:26:18.124190 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-8dc1333a-c3ae-4967-b559-30386962db87 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011194 Dec 08 11:26:18.124693 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Wed Dec 8 11:26:18 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:26:18.136862 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-139b9e18-c61a-4034-85d3-9da499c06bb4 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:26:18.145187 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-139b9e18-c61a-4034-85d3-9da499c06bb4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011357 Dec 08 11:26:18.145656 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Wed Dec 8 11:26:18 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:26:18.157622 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:26:18.165008 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010759 Dec 08 11:26:18.165559 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Wed Dec 8 11:26:18 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:27:44.488879 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-7dbecb96-ad5b-46e2-9aa5-be7aeb320863 tempest-verify_tempest_config-116457066 tempest-verify_tempest_config-116457066-project] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:27:44.490905 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-7dbecb96-ad5b-46e2-9aa5-be7aeb320863 tempest-verify_tempest_config-116457066 tempest-verify_tempest_config-116457066-project] 10.222.0.66 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103803 Dec 08 11:27:44.491464 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 34/69] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Dec 8 11:27:44 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:29:12.212397 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:12.213422 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 08 11:29:12.213858 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 36/70] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:29:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:29:12.462539 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-e825d9ab-e4cf-4ab0-bd16-d65683d0dce0 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:12.464197 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:29:12.464197 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: warnings.warn(msg) Dec 08 11:29:12.465814 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-e825d9ab-e4cf-4ab0-bd16-d65683d0dce0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:12.466256 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-e825d9ab-e4cf-4ab0-bd16-d65683d0dce0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:12.467047 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-e825d9ab-e4cf-4ab0-bd16-d65683d0dce0 admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:12.467467 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-e825d9ab-e4cf-4ab0-bd16-d65683d0dce0 admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:12.499939 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-e825d9ab-e4cf-4ab0-bd16-d65683d0dce0 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148398 Dec 08 11:29:12.500486 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 35/71] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Dec 8 11:29:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:29:13.996934 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:13.997925 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 08 11:29:13.998333 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 37/72] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:29:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:29:14.189399 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-7e351892-4e42-4adc-a140-a750e202636d admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:14.190557 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:29:14.190557 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: warnings.warn(msg) Dec 08 11:29:14.192048 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-7e351892-4e42-4adc-a140-a750e202636d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:14.192482 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-7e351892-4e42-4adc-a140-a750e202636d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:14.193298 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-7e351892-4e42-4adc-a140-a750e202636d admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:14.193718 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-7e351892-4e42-4adc-a140-a750e202636d admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:14.212136 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-7e351892-4e42-4adc-a140-a750e202636d admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074160 Dec 08 11:29:14.212594 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 36/73] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Dec 8 11:29:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:29:26.080211 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:26.081771 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Dec 08 11:29:26.082371 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 38/74] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:29:26 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:29:26.273736 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-75910d96-142a-4836-88c9-aa3ebf03821e admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:26.274892 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:29:26.274892 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: warnings.warn(msg) Dec 08 11:29:26.276420 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-75910d96-142a-4836-88c9-aa3ebf03821e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:26.276855 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-75910d96-142a-4836-88c9-aa3ebf03821e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:26.277673 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-75910d96-142a-4836-88c9-aa3ebf03821e admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:26.278093 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-75910d96-142a-4836-88c9-aa3ebf03821e admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:26.302022 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-75910d96-142a-4836-88c9-aa3ebf03821e admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078820 Dec 08 11:29:26.302563 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 37/75] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Dec 8 11:29:26 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:29:27.794405 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: DEBUG nova.api.openstack.wsgi [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] Calling method '>' {{(pid=101592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:27.795419 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: INFO nova.api.openstack.requestlog [None req-b7e22f58-2e1a-4d6f-be32-c9176c2b8974 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Dec 08 11:29:27.795845 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: [pid: 101592|app: 0|req: 39/76] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Dec 8 11:29:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:29:27.985010 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG nova.api.openstack.wsgi [None req-38a839a7-5eb9-492b-b2f5-244591ddf1c5 admin admin] Calling method '>' {{(pid=101591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:29:27.986221 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:29:27.986221 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: warnings.warn(msg) Dec 08 11:29:27.987710 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-38a839a7-5eb9-492b-b2f5-244591ddf1c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:27.988140 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-38a839a7-5eb9-492b-b2f5-244591ddf1c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:27.988950 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-38a839a7-5eb9-492b-b2f5-244591ddf1c5 admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:29:27.989411 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: DEBUG oslo_concurrency.lockutils [None req-38a839a7-5eb9-492b-b2f5-244591ddf1c5 admin admin] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:29:28.010866 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: INFO nova.api.openstack.requestlog [None req-38a839a7-5eb9-492b-b2f5-244591ddf1c5 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075515 Dec 08 11:29:28.011418 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: [pid: 101591|app: 0|req: 38/77] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Dec 8 11:29:27 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:30:24.917599 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: Wed Dec 8 11:30:24 2021 - graceful shutdown triggered... Dec 08 11:30:24.917731 dv-cinder-819778-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 08 11:30:24.918516 dv-cinder-819778-3-iscsi devstack@n-api.service[101591]: Gracefully killing worker 1 (pid: 101591)... Dec 08 11:30:24.918964 dv-cinder-819778-3-iscsi devstack@n-api.service[101592]: Gracefully killing worker 2 (pid: 101592)... Dec 08 11:30:25.918736 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: worker 1 buried after 1 seconds Dec 08 11:30:25.919238 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: worker 2 buried after 1 seconds Dec 08 11:30:25.919238 dv-cinder-819778-3-iscsi devstack@n-api.service[101590]: goodbye to uWSGI. Dec 08 11:30:25.920317 dv-cinder-819778-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 08 11:30:25.920918 dv-cinder-819778-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 08 11:30:25.923647 dv-cinder-819778-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 08 11:30:25.933678 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 08 11:30:25.935770 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 8 11:30:25 2021] *** Dec 08 11:30:25.935932 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 08 11:30:25.936101 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 08 11:30:25.936278 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: nodename: dv-cinder-819778-3-iscsi Dec 08 11:30:25.936462 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: machine: x86_64 Dec 08 11:30:25.936633 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: clock source: unix Dec 08 11:30:25.936808 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: pcre jit disabled Dec 08 11:30:25.936977 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: detected number of CPU cores: 4 Dec 08 11:30:25.937190 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: current working directory: / Dec 08 11:30:25.937423 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: detected binary path: /usr/bin/uwsgi-core Dec 08 11:30:25.937638 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: your processes number limit is 47680 Dec 08 11:30:25.937833 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: your memory page size is 4096 bytes Dec 08 11:30:25.938015 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: detected max file descriptor number: 2048 Dec 08 11:30:25.938140 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: lock engine: pthread robust mutexes Dec 08 11:30:25.938421 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: thunder lock: enabled Dec 08 11:30:25.938774 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 08 11:30:25.939121 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 08 11:30:25.986416 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: Python main interpreter initialized at 0x55de3b25f9c0 Dec 08 11:30:25.986416 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: python threads support enabled Dec 08 11:30:25.986416 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: your server socket listen backlog is limited to 100 connections Dec 08 11:30:25.986416 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: your mercy for graceful operations on workers is 90 seconds Dec 08 11:30:25.986847 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: mapped 403077 bytes (393 KB) for 2 cores Dec 08 11:30:25.986847 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: *** Operational MODE: preforking *** Dec 08 11:30:25.987163 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: *** uWSGI is running in multiple interpreter mode *** Dec 08 11:30:25.987163 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: spawned uWSGI master process (pid: 117249) Dec 08 11:30:25.987365 dv-cinder-819778-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 08 11:30:25.987967 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: spawned uWSGI worker 1 (pid: 117269, cores: 1) Dec 08 11:30:25.988488 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: spawned uWSGI worker 2 (pid: 117270, cores: 1) Dec 08 11:30:25.988768 dv-cinder-819778-3-iscsi devstack@n-api.service[117249]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 08 11:30:27.890897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:30:27.890897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: from cryptography.utils import int_from_bytes Dec 08 11:30:27.891591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:30:27.891591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: from cryptography.utils import int_from_bytes Dec 08 11:30:27.900253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:30:27.900253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: from cryptography.utils import int_from_bytes Dec 08 11:30:27.900860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:30:27.900860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: from cryptography.utils import int_from_bytes Dec 08 11:30:30.381480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:30:30.382040 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:30:30.382319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:30:30.382594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:30:30.382853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:30:30.383252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.383653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.384027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.384415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.385458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.385584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.385909 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.386237 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.386572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.386837 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.387161 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.387494 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-3-iscsi {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.387817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.388132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.388453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.388773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.389081 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.389808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.389808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.390242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.391285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.391285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.391991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.392585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.393180 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.393715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.394287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.394827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.395653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.396162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.396699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-3-iscsi {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.397243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.397574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.397953 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.398382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.398702 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.399057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.399398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.399751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.400104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.400440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.400766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.401093 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.401446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.401844 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.402169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.402487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.402815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.403128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.403439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.403908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.404081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:30:30.404496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.404593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.404683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:30:30.404874 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.405285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.405477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:30:30.405595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.405731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.406057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.406352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:30:30.406473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.406686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.407001 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.407118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:30:30.407316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.407626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.407729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.407937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.408251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.408358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.408560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.408828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.408938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.409205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.409319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.409540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.409709 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.409858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.410183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.410292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.410628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.410747 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.411026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.411141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.411369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.411685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.411788 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.412032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.412133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.412360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.412476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.412676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.412901 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-3-iscsi {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.413013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.413339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.413454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.413661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.413767 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.413978 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.414194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.414301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.414606 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.414753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.414949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.415234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.415338 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.416347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.416463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.416741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.416985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.417103 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.417404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.417727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.417830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.418047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.418268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.418378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.418656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.418814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.418964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.419281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.419397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.419592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.419825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.419942 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.420217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.420331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.420528 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.420640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.420839 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.421090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.421209 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.421700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.421807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.422048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.422156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.422377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.422476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.422692 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.422860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-3-iscsi {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423338 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.423957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.424234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.424337 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.424546 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.424873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.429964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430347 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430664 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.430964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.431126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.432161 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.432161 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.432734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.432734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.433049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.433401 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.433752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.434073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.434289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.434448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.434735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.435059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.435378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.435700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.435906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.436139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.436334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.436654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.436970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.437328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.437623 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.437804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.437954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.438280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.438600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.438896 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.439061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.439220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.439531 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.439865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.440103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.440216 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.440506 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.440852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.441179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.441649 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.441953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.442066 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.442301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.442621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.442952 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.443212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.443322 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.443573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.443891 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.444239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.444490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.444602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.445071 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.445628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.446176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.446352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.446699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.447184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.447566 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.447869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.447973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.448216 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.448539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.448863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.448999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.449350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.449473 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.449705 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.450041 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.450157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.450363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.450634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.450738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.451017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.451168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.451359 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.451653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.451764 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.451970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.452253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.452411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.453116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.453330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.453330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.453636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.453830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.453951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.454038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.454119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.454191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.454260 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.454335 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.455318 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.455490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.455649 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.455793 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.455940 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.456057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.456171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.456322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.456458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.456588 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.456722 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.456722 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.456959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.457058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.457141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.457319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.457389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.457459 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.457781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.457949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.458108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.458255 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.458879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.459151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.459151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.459615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.459862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.460086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.460299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.460457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.460627 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.460787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.460942 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.461095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.461279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.462558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.462732 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.462909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.463372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.463540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.463687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.463831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.463985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.464153 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.464300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.464450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.464595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.464595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.465103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.465630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.465630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.465630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.465630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.465630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.465630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.466467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.466467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.466467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.466467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.467812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.467812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.468111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.468268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.468415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.468559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.468559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.468559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.468559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.469112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.469577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.469724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.469724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.470023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.470284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.470459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.470721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.471054 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.471382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.471724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.472050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.472376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.472711 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.473438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.473438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.473758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.473999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.474321 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.474892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.475238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.475238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.475816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.476151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.476317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.476472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.476632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.476784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.476930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.477074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.477319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.477319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.477656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.478526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.478876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.479043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.479190 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.479341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.479526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.479690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.479843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.479998 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.480167 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.480325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.480493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.480644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.480819 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.481230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.481618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:30:30.481948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.482301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.482523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.482712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.482878 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.484460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.484645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.484808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.484966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.485378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.485550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.486446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.486605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.486763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.486919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.487094 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.487240 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.487385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.487536 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.487689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.487834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.488017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.488249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.488406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.488560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.488706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.488850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.489006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.489184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.489336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.489639 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.489805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.489964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.490110 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.490261 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.490413 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.490557 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.490861 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.491021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.491168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.491321 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.491479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.491479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.491882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.492042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.493328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.493328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.493658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.494346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.494346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.494346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.494346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.495139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.495139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.495597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.495597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.495976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.496601 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.496766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.496926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.497086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.497280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.497428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.497648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.497876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.498113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.498485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.498485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.498937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.499169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.499352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.499515 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.499685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.499856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.500083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.500314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.500314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.500770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.501019 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.501280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.501492 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.501747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502000 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502236 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.502982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.503269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.503420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.503814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.504218 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.504475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.507434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.507869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.508189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.508586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.508756 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.508913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.509069 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.509313 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.509479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.509648 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.509798 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.509981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.510133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.510326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.510502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.510686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.510929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.511089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.511285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.511460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.511614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.511767 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.511931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.512085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.512240 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.512385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.512551 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.512701 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.512896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.513047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.513272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.514174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.514174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.514471 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.514663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.514831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.515227 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.515394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.515540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.515856 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.516025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.516273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.516434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.516434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.516743 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.517091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.517091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.517414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.517592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.517945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.518659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.520821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.522580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.522754 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.522930 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.523098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.523256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.523410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.523557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.523701 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.523855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524009 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524612 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.524958 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.525368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.525538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.525694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.525860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.527578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.527748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.527910 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.528067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.528215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.528361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.528515 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.528675 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.528923 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.529083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.529271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.530326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.530497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.530656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.530806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.530953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531412 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531412 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531412 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.531998 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.532155 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.532302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.532453 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.532598 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.532741 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.532885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533832 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.533986 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.534132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.534278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.534422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.534566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.534719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.534878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.535033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.535197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.538539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.538716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.538872 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.539137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.539308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.539468 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.539624 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.539771 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.539916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.540068 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.540231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.540386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.541088 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.541268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.542480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.542638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.542803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.542952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.543429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.544779 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.544934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.545081 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.545397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.545837 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.546007 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.546184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.546781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.546959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.547115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.547275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.547275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.547571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.547718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.547862 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.548355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.548517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.548674 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.548821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.548967 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.549136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.549383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.549558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.549720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.549873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550028 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550612 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550612 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.550893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551183 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551785 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551862 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.551997 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.552824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.553603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.553603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.553861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.553999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.554541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555359 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.555814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.556029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.556119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.556275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557133 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557312 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557312 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.557964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.558106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.558500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.558629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.558769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.558900 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559036 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559524 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.559916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560445 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560861 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.560946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561739 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.561920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562002 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562549 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562732 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.562921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563181 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563635 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563811 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.563989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564071 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564153 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564327 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564645 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.564974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.565301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.565541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.565775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.565901 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566255 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.566945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.567219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.567363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.567502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.567639 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.567841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.567987 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.568148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.568305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.568689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.568826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.568964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.569094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.569258 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.569401 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.569622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.569761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.569901 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.570061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.570191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.570379 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.570513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.570716 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.570848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.571050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.571195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.571368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.571467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.571690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.571803 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.572030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.572136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.572362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.572461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.572690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.572781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.573011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.573117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.573363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.573516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.573686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.573933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.574065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.574266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.574399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.574586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.574918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.575259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.575570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.575885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.576082 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.576203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.576502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.576816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.577344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.577583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.577928 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.578264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.578782 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.579187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.579533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581412 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581805 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.581953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582170 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582239 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582812 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582894 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.582974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.583404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.583522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.583679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.583819 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.584030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.584136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.584264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.584490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.584811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.584931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.585134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.585261 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.585478 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.585633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.585801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.585936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.586152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.586284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.586589 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.586752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.586894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587764 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587864 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.587958 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.588144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.588262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.588488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.588813 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.589143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.589521 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.589852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.589953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.590152 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.590326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.590474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.590673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.590795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.591028 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.591118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.591375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.591463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.591709 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.591798 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592427 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592657 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.592991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.593071 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.593384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.593737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.593828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.593909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.593994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.594065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.594295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.594397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.594585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.594667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.595035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.595126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.595394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.595476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.595782 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.595870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.596110 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.596191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.596433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.596621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.596870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.597075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.597284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.597607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.597864 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.597990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.598205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.598338 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.598560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.598702 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.599056 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.599301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.599427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.599638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.599820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.599961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.600146 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.600270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.600422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.600597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.600724 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.600920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.601043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.601416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.601565 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.601686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.601797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.601913 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.602030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.602238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.602563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.602763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.602906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.603610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.603721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.604158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.604298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.604398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.604711 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.605044 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.605302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.605459 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.605623 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.605772 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.605916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.606067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.606210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.606362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.606543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.606829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.607132 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.607279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.607422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.607579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.607824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.607983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.608127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.608270 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.608270 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.608562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.608718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.608873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.609022 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.609391 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.609557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.609707 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.609858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.609858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.610168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.610396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.610551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.610695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.610852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.611931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612236 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612530 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612678 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.612984 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.613130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.613313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.613456 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.613599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.613759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.613912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.614126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.614277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.614459 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.614682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.614838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.615004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.615157 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.615307 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.615560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.615718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.615954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.616211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.616364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.616537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.616693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.616926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.617264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.617420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.617576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.617720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.617952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.618116 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.618268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.618419 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.618562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.619310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.619548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.619704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.619855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.619999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.620142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.620297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.620539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.620699 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.620844 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.620987 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.621294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.621447 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.621591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.621743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.621893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622038 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622332 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622504 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.622952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.623966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.624108 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.624336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.624482 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.624625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.624813 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.624970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.625407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.625584 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.625747 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.625900 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.626043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.626192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.626348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.626493 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.626831 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.627074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.627384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.627534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.627690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.627834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.628062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.628062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.628350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.628499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.628676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.628964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.629113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.629390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.629727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.629912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.630075 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.630230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.630381 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.630543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.630761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.631010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.631342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.631663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.631954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.632124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.632279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.632512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.632669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.632837 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.633173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.633334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.633479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.633705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.633854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.633996 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.634146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.634311 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.634574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.634912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.635037 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.635329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.635474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.635775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.635887 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.636090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.636186 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.636420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.636514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.636859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.637124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.637586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.637744 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.637892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.637892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.638280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.638440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.638586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.638729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.638880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.638880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.639168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.639322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.639473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.639627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.639900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.640106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.640264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.640409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.640559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.640710 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.640881 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.641967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.642136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.642475 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.642629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.642629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.642909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643207 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.643979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.644124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.644267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.644410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.644560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.644722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.644883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.645335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.645802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.645967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.646114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.646277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.646425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.646575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.646727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.646872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.647023 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.647181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.647333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.647333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.647853 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.647999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.648150 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.648325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.648558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.648715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.648867 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.649021 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.649192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.649192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.649492 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.649646 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.649791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.650206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.650373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.650373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.650664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.650827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.650972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.651116 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.651273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.651425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.651575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.651729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.651873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.652023 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.652023 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.652310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.652460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.652628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.652781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653054 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653247 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.653974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.654118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.654262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.654262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.654551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.654715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.654870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655015 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655164 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655604 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.655911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656200 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656814 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.656967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.657112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.657325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.657480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.657860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.658014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.658166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.658310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.658466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.658701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.658863 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659010 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659153 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659304 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659605 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.659902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.660074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.660310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.660530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.660678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.660830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.660994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.661225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.661377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.661541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.661688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.661842 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.661995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.662150 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.662296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.662468 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.662621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.662765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.662920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663222 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.663949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.664106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.664259 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.664404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.664558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.664711 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.664869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.665027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.665204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.665355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666179 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666489 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.666968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.667332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.667511 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.667671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.668031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.668183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.668327 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.668483 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.668736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.668960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.669111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.669290 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.669435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.669676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.669837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:30:30.670852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.670852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.671399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.671399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.672272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.672272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.672580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.672733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.672992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.673485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.673810 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.674041 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.674377 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.674788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.675322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.675491 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.675754 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.676083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.676406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.676763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.677083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.677444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.677772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.678185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.678410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.678750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.679065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.679389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.679793 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.680043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.680467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.680725 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.681062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.682191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.682374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.682625 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.683211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.683538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.684024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.684219 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.684558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.684892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.685253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.685598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.685921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.686242 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.686730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.686890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.687204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.687539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.687955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.689080 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.689649 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.689911 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.690487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.692543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.692543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.692543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.692543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.692543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.692543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.693048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.693048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.693367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.693691 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.694095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.694343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.694773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.695095 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:30.695272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.695272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.695577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.696864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.696864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.696864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.697121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.697413 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.697750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.698083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.698410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.699513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.699848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.700180 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.700517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.700848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.701211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.701542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.701873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.702209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.702525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.702847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.703192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.703517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.703839 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.704176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.704503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.704844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.705200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.705622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.705886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.706220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.706806 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.707366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.707534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.707895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.708703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.708703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.708892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.709225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.709547 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.709873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.710198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.710524 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.710850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.711173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.711500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.711825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.712148 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.712517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.712838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.714930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.714930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.714930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.714930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.714930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.714930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.715379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.715450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.715735 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.716065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.716416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.716748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.717067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.717534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.717868 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.718198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.718531 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.718857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.719195 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.719533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.719854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.720186 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.720512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.720855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.721264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.721609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.721951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.722270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.722586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.722908 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.723230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.723573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.723916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.724244 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.724580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.724901 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.725278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.725603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.725936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.726273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.726603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.726926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.727272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.727596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.727921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.728772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.729097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.730386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.730791 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.731084 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.731442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.731772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.732122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.732467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.732814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.733176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.733503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.733853 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.734185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.734520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.734851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.735179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.735513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.735848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.736192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.736543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.736885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.737254 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.737620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.737950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.738309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.738656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.738984 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.739314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.739642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:30:30.739893 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:30:30.763140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_db.sqlalchemy.engines [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:30.767229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.context [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7033496-1996-4048-927c-ede6e1628ed2(cell1) {{(pid=117269) load_cells /opt/stack/nova/nova/context.py:464}} Dec 08 11:30:30.773876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:30:30.775948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:30:30.776921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:30:30.778948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:30:30.793675 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:30.794999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:30.837121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.context [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7033496-1996-4048-927c-ede6e1628ed2(cell1) {{(pid=117270) load_cells /opt/stack/nova/nova/context.py:464}} Dec 08 11:30:30.841945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:30:30.844066 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:30:30.844903 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:30:30.846895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:30:30.860198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_db.sqlalchemy.engines [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:30.861326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_db.sqlalchemy.engines [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:30.958054 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:31.028784 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_db.sqlalchemy.engines [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:30:31.306910 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: WARNING keystonemiddleware.auth_token [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:30:31.314222 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: WARNING keystonemiddleware.auth_token [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:30:31.391119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: WARNING keystonemiddleware.auth_token [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:30:31.398352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: WARNING keystonemiddleware.auth_token [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:30:31.689477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: WARNING keystonemiddleware.auth_token [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:30:31.694729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: WARNING keystonemiddleware.auth_token [None req-7dba5e79-4c05-44ab-8c4a-e7c8a8da9484 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:30:31.700597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de3b25f9c0 pid: 117269 (default app) Dec 08 11:30:31.767533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: WARNING keystonemiddleware.auth_token [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:30:31.774652 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: WARNING keystonemiddleware.auth_token [None req-1549ce6d-2b6b-4599-aed8-7caa3df7c1d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:30:31.780518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de3b25f9c0 pid: 117270 (default app) Dec 08 11:31:06.207428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7c0566c8-d1ef-44c0-9240-f13ff8d3fc1b tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Action: 'create', calling method: .version_select at 0x7f1fa84cd790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-487531272", "metadata": {"Type": "work"}}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:07.156645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-421942977", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "d0180d44-2173-43bc-b3b2-67db13c39ea0"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:08.504052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7c0566c8-d1ef-44c0-9240-f13ff8d3fc1b tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.001085 Dec 08 11:31:08.506096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Dec 8 11:31:04 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4006 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 08 11:31:08.595405 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] validate_networks() for [('d0180d44-2173-43bc-b3b2-67db13c39ea0', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:31:08.866714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-828061040", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "6e4bda07-1ae1-4be4-bf28-e94211f51919"}]}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:09.072465 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] validate_networks() for [('6e4bda07-1ae1-4be4-bf28-e94211f51919', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:31:10.668613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:31:10.669243 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:31:10.669854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:31:10.670947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:31:10.672068 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:31:10.691020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:31:10.692101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:31:10.692912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:31:10.693470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:31:10.695145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:31:10.733195 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:10.748942 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:10.750184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:10.750841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:10.751295 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:10.753391 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:10.754292 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:10.757907 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:10.885651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Getting quotas for project 1770e8f8a0b34c0aa4adafccc2df6628. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:10.889822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:10.903766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for user 3d93916bc3fd40fb8f60f9b7a592a29f and project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:10.915169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Getting quotas for user e3a52dcd9f0b4ce2979b31773725ca07 and project 1770e8f8a0b34c0aa4adafccc2df6628. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:10.935058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:31:10.942396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:31:10.943095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:31:10.948806 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:31:11.151654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4ed0da05-3861-4002-8423-20429aa2518f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.643984 Dec 08 11:31:11.152718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 2/2] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:31:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:31:11.161948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ae36986e-8768-4980-87c2-a168ef6e08ab tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Calling method '.version_select at 0x7f1fa723b040>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:11.227334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d8ec3c56-529e-4da1-a631-19864916930b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.198712 Dec 08 11:31:11.228403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:31:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 5201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:31:11.237856 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0e76c521-332f-4849-8026-b5bbba016170 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:11.238381 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0e76c521-332f-4849-8026-b5bbba016170 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:11.321072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ae36986e-8768-4980-87c2-a168ef6e08ab tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17" status: 200 len: 353 microversion: 2.1 time: 0.166374 Dec 08 11:31:11.321683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:31:11 2021] GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:11.331793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-27863717-ee08-495f-9f83-45353706c452 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:11.332424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-27863717-ee08-495f-9f83-45353706c452 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:11.561116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0e76c521-332f-4849-8026-b5bbba016170 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:11.591659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0e76c521-332f-4849-8026-b5bbba016170 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1217 microversion: 2.1 time: 0.361816 Dec 08 11:31:11.601217 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 2/5] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:11 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1217 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:11.615330 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3f36a149-95ef-4d15-a6d3-269ee5edfb43 tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Calling method '.version_select at 0x7f1fa7ad5e50>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:11.632712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-27863717-ee08-495f-9f83-45353706c452 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:11.666369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-27863717-ee08-495f-9f83-45353706c452 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1214 microversion: 2.1 time: 0.343575 Dec 08 11:31:11.667204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:11 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1214 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:11.868213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3f36a149-95ef-4d15-a6d3-269ee5edfb43 tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17" status: 200 len: 353 microversion: 2.1 time: 0.267531 Dec 08 11:31:11.868832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:31:11 2021] GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17 => generated 353 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:11.889875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-76ac5994-1812-480e-93b0-3a025526680c tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Calling method '.version_select at 0x7f1fa7247790>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:12.066972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-76ac5994-1812-480e-93b0-3a025526680c tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17" status: 202 len: 0 microversion: 2.1 time: 0.178563 Dec 08 11:31:12.068333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Dec 8 11:31:11 2021] DELETE /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:31:12.077099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c3e7ed6c-02ee-4f5a-9db5-a47b62ae6be1 tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Calling method '.version_select at 0x7f1fa7285c10>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:12.213193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c3e7ed6c-02ee-4f5a-9db5-a47b62ae6be1 tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17" status: 200 len: 352 microversion: 2.1 time: 0.140567 Dec 08 11:31:12.213828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 4/9] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:31:12 2021] GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:12.608756 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6cb7f63b-6dc1-4c16-9f5c-ec5ee6229af0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:12.609700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6cb7f63b-6dc1-4c16-9f5c-ec5ee6229af0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:12.684958 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9f7ff9c5-cd3c-4ee2-8fad-fc405d59659c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:12.685909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9f7ff9c5-cd3c-4ee2-8fad-fc405d59659c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:12.885563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9f7ff9c5-cd3c-4ee2-8fad-fc405d59659c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:12.894093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9f7ff9c5-cd3c-4ee2-8fad-fc405d59659c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1214 microversion: 2.1 time: 0.213680 Dec 08 11:31:12.896021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:12 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:12.913390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6cb7f63b-6dc1-4c16-9f5c-ec5ee6229af0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:12.920626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6cb7f63b-6dc1-4c16-9f5c-ec5ee6229af0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1217 microversion: 2.1 time: 0.316236 Dec 08 11:31:12.928243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:12 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:13.230021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d247bf45-cf54-433b-b394-8bd6457fd9ad tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Calling method '.version_select at 0x7f1fa72665e0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:13.314713 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-d247bf45-cf54-433b-b394-8bd6457fd9ad tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] HTTP exception thrown: Volume ea4e0a8c-7784-4137-adbe-90ff79f66e17 could not be found. Dec 08 11:31:13.315560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d247bf45-cf54-433b-b394-8bd6457fd9ad tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] Returning 404 to user: Volume ea4e0a8c-7784-4137-adbe-90ff79f66e17 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:31:13.316393 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d247bf45-cf54-433b-b394-8bd6457fd9ad tempest-VolumesGetTestJSON-373668892 tempest-VolumesGetTestJSON-373668892-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17" status: 404 len: 109 microversion: 2.1 time: 0.094047 Dec 08 11:31:13.317086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:31:13 2021] GET /compute/v2.1/os-volumes/ea4e0a8c-7784-4137-adbe-90ff79f66e17 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:31:13.912227 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aae4276b-1812-40a9-b8bd-947c92ee7084 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:13.913458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aae4276b-1812-40a9-b8bd-947c92ee7084 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:13.945072 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:13.945891 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:13.960163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:13.965813 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:13.966865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:13.967424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:14.465049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aae4276b-1812-40a9-b8bd-947c92ee7084 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:14.475399 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aae4276b-1812-40a9-b8bd-947c92ee7084 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1214 microversion: 2.1 time: 0.566805 Dec 08 11:31:14.487244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:13 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1214 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:14.494044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:14.515030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f91a711a-6039-4432-b962-62ad9a42e666 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1269 microversion: 2.1 time: 0.574788 Dec 08 11:31:14.515877 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 7/14] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:13 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1269 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:15.495112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:15.495732 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:15.522806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:15.525696 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:15.527683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:15.528280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:15.533504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:15.534640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:15.542822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:15.544058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:15.548541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:15.553197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:16.312090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:16.322290 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d461c02d-4b89-4d5d-87ec-1ac23212f41f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1275 microversion: 2.1 time: 0.790736 Dec 08 11:31:16.323039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 8/15] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:15 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1275 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:16.360034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:16.381836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-de045da0-f719-4d36-9155-abc8692a1aaf tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1266 microversion: 2.1 time: 0.888744 Dec 08 11:31:16.383388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:15 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1266 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:17.357618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:17.359706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:17.396058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:17.399163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:17.401117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:17.412070 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:17.583205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-30211a35-231c-4def-acb4-09b1d5eb13e3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: .version_select at 0x7f1fa8468f70>, body: {"keypair": {"name": "tempest-keypair-2025329047"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:17.657899 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-30211a35-231c-4def-acb4-09b1d5eb13e3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:17.671609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-30211a35-231c-4def-acb4-09b1d5eb13e3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for user 19df77156f4d40bab9337d27d4301a31 and project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:18.017241 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-30211a35-231c-4def-acb4-09b1d5eb13e3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:18.027004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-30211a35-231c-4def-acb4-09b1d5eb13e3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for user 19df77156f4d40bab9337d27d4301a31 and project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:18.049387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-30211a35-231c-4def-acb4-09b1d5eb13e3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.115960 Dec 08 11:31:18.070773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 9/17] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Dec 8 11:31:16 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:18.110719 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:18.111368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:18.161478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:18.161929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:18.162738 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:18.176284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:18.428420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:18.476934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-757f326a-5791-4e7b-af23-a5166055de64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1275 microversion: 2.1 time: 1.125375 Dec 08 11:31:18.482578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 9/18] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:17 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1275 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:19.314470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:19.330532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-30b366fa-deb0-4b40-b599-0ee647ef22b2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1272 microversion: 2.1 time: 1.252311 Dec 08 11:31:19.338825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 10/19] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:18 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1272 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:19.499399 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:19.500087 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:19.525254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:19.528262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:19.532105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:19.534381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:20.325579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:20.341057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2078d534-1568-4193-b73b-3b200a0126a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1275 microversion: 2.1 time: 0.845508 Dec 08 11:31:20.359547 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:20.360755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:20.369774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 10/20] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:19 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1275 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:20.371776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:20.373080 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:20.376356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:20.378251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:21.369296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:21.369825 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:21.402848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:21.404571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:21.406908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:21.408764 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:21.552749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:21.564177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c4818407-a3f6-49f3-99dd-c8108fbab4bb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 1.208737 Dec 08 11:31:21.581092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 11/21] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:20 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:22.305351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:22.319382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.961750 Dec 08 11:31:22.331286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 11/22] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:21 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:22.609584 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:22.611373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:22.620516 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:22.621487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:22.622783 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:22.623766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:23.173863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2124088238", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "185aeb08-41ef-4fae-a420-33296f710850"}], "security_groups": [{"name": "tempest-securitygroup--179580436"}], "key_name": "tempest-keypair-2025329047", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:23.893978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:23.910092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2b8218bf-90da-4f47-9f73-846c152305e8 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 1.325588 Dec 08 11:31:23.912764 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:22 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:23.927690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:23.928435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:23.938438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] validate_networks() for [('185aeb08-41ef-4fae-a420-33296f710850', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:31:23.942631 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:23.947316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:23.952308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:23.954299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:25.202269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:25.221101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fd45b749-b876-48af-938f-662cac649b5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 1.303855 Dec 08 11:31:25.223591 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 13/24] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:23 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:25.467143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c9bb85e6-c28f-4711-85e4-5ac37b7d6a90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'create', calling method: .version_select at 0x7f1fa71b7b80>, body: {"keypair": {"name": "tempest-keypair-7215352"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:25.507281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-c9bb85e6-c28f-4711-85e4-5ac37b7d6a90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:25.515921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-c9bb85e6-c28f-4711-85e4-5ac37b7d6a90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for user c73027d527c3484985868045e24272e9 and project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:26.291636 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:31:26.292362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:31:26.292971 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:31:26.293516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:31:26.295735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:31:26.315117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:26.315983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:26.318564 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:26.319809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:26.358682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:26.383703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for user 19df77156f4d40bab9337d27d4301a31 and project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:26.423325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:31:26.426807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:31:26.444170 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-c9bb85e6-c28f-4711-85e4-5ac37b7d6a90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:26.466835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-c9bb85e6-c28f-4711-85e4-5ac37b7d6a90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for user c73027d527c3484985868045e24272e9 and project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:26.518552 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c9bb85e6-c28f-4711-85e4-5ac37b7d6a90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2313 microversion: 2.20 time: 1.292606 Dec 08 11:31:26.526425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 14/25] 10.222.0.66 () {62 vars in 1198 bytes} [Wed Dec 8 11:31:25 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 1301 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 08 11:31:26.530915 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:26.531537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:26.544180 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.376703 Dec 08 11:31:26.550618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 12/26] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:31:23 2021] POST /compute/v2.1/servers => generated 401 bytes in 3383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:31:26.578323 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:26.578782 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:26.579618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:26.580043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:26.977770 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:26.980541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:26.980541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:31:27.009976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:27.010728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:27.103020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 service nova] Creating event network-changed:d9ecab87-157e-4ccb-8423-2248bb8451ea for instance c7fa09fb-ae2b-4479-8848-f142131fe33a on hv-cinder-81977 Dec 08 11:31:27.104547 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 08 11:31:27.109528 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:27.111899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:27.113913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:27.117600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:27.142787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.compute.rpcapi [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 08 11:31:27.144295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 08 11:31:27.219367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e3485969-41d5-438b-b10b-01751eed7ef2 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.653813 Dec 08 11:31:27.219367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 13/27] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:27.219367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:27.219367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:27.231833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:27.234618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:27.235580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:27.238968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:27.269278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:27.299813 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-14443596-860c-4ced-bc2b-60393c38273c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.772472 Dec 08 11:31:27.308726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 15/28] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:26 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:27.350404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-590b53d0-cd08-4c8d-bd2c-65effe4396e2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:27.355312 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-590b53d0-cd08-4c8d-bd2c-65effe4396e2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:28.164982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-590b53d0-cd08-4c8d-bd2c-65effe4396e2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:28.177481 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-590b53d0-cd08-4c8d-bd2c-65effe4396e2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1238 microversion: 2.1 time: 0.866946 Dec 08 11:31:28.191218 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 16/29] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:27 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1238 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:28.333103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:28.334735 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:28.379203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:28.380940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:28.384172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:28.386498 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:29.596597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:29.606267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-18904506-dfbe-4e98-852a-263dd6a3f3e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 2.398300 Dec 08 11:31:29.615717 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 14/30] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:27 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:29.626792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:29.632723 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:29.652920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:29.653655 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:29.654629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:29.655223 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:30.447447 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:30.468386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 2.145710 Dec 08 11:31:30.470091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 17/31] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:28 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:30.481869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-91df3301-3b3c-42b3-b285-49d220297a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:30.485879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:30.485879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:31:30.496758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-91df3301-3b3c-42b3-b285-49d220297a4c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:30.497231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-91df3301-3b3c-42b3-b285-49d220297a4c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:30.517988 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-91df3301-3b3c-42b3-b285-49d220297a4c service nova] Creating event network-changed:8e4b1127-3db2-4f93-a731-315192c060b3 for instance fe445662-9a2d-4c17-96ea-b054be927e53 on hv-cinder-81977 Dec 08 11:31:30.518534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-91df3301-3b3c-42b3-b285-49d220297a4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 08 11:31:30.520054 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:30.520675 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:30.522222 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:30.523008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:30.556144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.compute.rpcapi [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 08 11:31:30.559906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 08 11:31:30.568281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:30.576437 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-01784795-3450-4a3a-a11a-224aaf8e1786 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1290 microversion: 2.1 time: 0.959301 Dec 08 11:31:30.584980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 15/32] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:29 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1290 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:30.627571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:30.628291 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:30.629728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-46d97d5d-692b-410b-837c-b79373e74cf9 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151615 Dec 08 11:31:30.630397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 18/33] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:30.639197 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:30.645884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:30.646986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:30.647593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:30.946995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:30.957896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.333842 Dec 08 11:31:30.959526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 16/34] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:30 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:31.488125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:31.489034 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:31.500271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:31.500271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:31.500271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:31.500977 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:31.602050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:31.602880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:31.611725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:31.612298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:31.614549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:31.615005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:31.663779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:31.671919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-796054b2-9b37-4ee1-a894-2e1bf3a46591 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.189592 Dec 08 11:31:31.672956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 19/35] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:31 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:31.703405 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:31.711124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-31aab7a0-3075-41df-89ff-d584b0e33bd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1290 microversion: 2.1 time: 0.113528 Dec 08 11:31:31.720811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 17/36] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:31 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:31.975541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:31.976721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:31.982615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:31.983509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:31.984933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:31.985711 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:32.081289 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-737898438", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd37a1fc-3614-462b-92a2-b41260c949a2"}], "security_groups": [{"name": "tempest-securitygroup--1884414149"}], "key_name": "tempest-keypair-7215352", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:32.411233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] validate_networks() for [('fd37a1fc-3614-462b-92a2-b41260c949a2', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:31:32.445653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:32.457367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.484090 Dec 08 11:31:32.471632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 20/37] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:31 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:32.690305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:32.691556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:32.704417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:32.705690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:32.707044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:32.709812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:33.292946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:33.303603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.618376 Dec 08 11:31:33.318094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 21/38] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:32 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:33.325633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:33.327049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:33.335177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:33.336047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:33.337345 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:33.338050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:33.470517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:33.486643 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1296 microversion: 2.1 time: 0.167159 Dec 08 11:31:33.497418 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 22/39] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:33 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:33.502172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:33.503199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:33.527910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:33.527910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:33.527910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:33.528262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:34.404799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:34.417339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-03cc7a62-eda3-4993-9482-81419f5d1b76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.919664 Dec 08 11:31:34.418933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 23/40] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:33 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:34.427437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:34.428290 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:34.436928 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:34.438146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:34.439395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:34.440620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:34.476170 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:31:34.477558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:31:34.478248 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:31:34.479007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:31:34.479857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:31:34.498519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:34.500204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:34.502232 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:34.503467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:34.539531 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for project 44406e332fd94f1a9dcd704577410a61. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:34.546640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for user c73027d527c3484985868045e24272e9 and project 44406e332fd94f1a9dcd704577410a61. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:34.563164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:31:34.568948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:31:34.659723 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e6c2b308-d9c0-403f-b176-ee10abd8104e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.582419 Dec 08 11:31:34.664492 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 18/41] 10.222.0.66 () {62 vars in 1187 bytes} [Wed Dec 8 11:31:32 2021] POST /compute/v2.1/servers => generated 402 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 08 11:31:34.676575 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:34.682127 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:34.697735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:34.698581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:34.700096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:34.701315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:35.100352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:35.109748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a6114b21-624a-4e4e-be02-d048a98e9962 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.688060 Dec 08 11:31:35.113441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 24/42] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:34 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:35.118318 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:35.127448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:35.338389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:35.352053 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:35.356241 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:35.361708 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:35.367930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1278 microversion: 2.20 time: 0.243157 Dec 08 11:31:35.376707 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 25/43] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:35 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:35.380160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5b16b02b-d2a1-494e-91db-fc120dbb5646 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.714274 Dec 08 11:31:35.390183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 19/44] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:34 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:35.436022 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:35.436645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:35.458808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:35.461196 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:35.465409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:35.466965 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:35.722039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:35.734605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b64d4119-1ea1-4f84-a772-38fd49c08113 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.301853 Dec 08 11:31:35.736945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 26/45] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:35 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:36.023735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-00a6af48-4561-463d-a510-91dbe6b13e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:36.025346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:36.025346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:31:36.032897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-314643fb-1427-4675-a0df-6cc895c05540 req-00a6af48-4561-463d-a510-91dbe6b13e60 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.033747 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-314643fb-1427-4675-a0df-6cc895c05540 req-00a6af48-4561-463d-a510-91dbe6b13e60 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.047850 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-314643fb-1427-4675-a0df-6cc895c05540 req-00a6af48-4561-463d-a510-91dbe6b13e60 service nova] Creating event network-changed:731fa8a4-e27d-4561-a86e-aa21c87548e7 for instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 on hv-cinder-81977 Dec 08 11:31:36.055362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-314643fb-1427-4675-a0df-6cc895c05540 req-00a6af48-4561-463d-a510-91dbe6b13e60 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.375637 Dec 08 11:31:36.056735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 20/46] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:31:36.134213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:36.134862 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:36.142940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.146962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.147837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.148291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.388914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:36.390084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:36.399889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.402766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.403671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.404148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.550102 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:36.558372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:36.560068 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:36.561266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-934b37c8-b060-4d75-b50e-8a9ccf045854 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1348 microversion: 2.20 time: 0.176409 Dec 08 11:31:36.570948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 21/47] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:36 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1348 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:36.576027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:36.576902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:36.582994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.583755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.585480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.585938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.603171 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:36.620017 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.491499 Dec 08 11:31:36.620797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 27/48] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:36 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:36.753079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:36.753722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:36.771175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.771523 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.773527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:36.774481 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:36.935400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:36.942781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b231ba5f-2224-42f5-b11b-f735a90c59e0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.370538 Dec 08 11:31:36.945982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 22/49] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:36 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:37.058781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:37.068773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.318867 Dec 08 11:31:37.080946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 28/50] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:36 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:37.588189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:37.588814 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:37.604791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:37.605328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:37.606088 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:37.606564 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:37.639833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:37.640967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:37.655908 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:37.656546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:37.657681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:37.658682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:37.716129 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:37.729323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:37.733269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:37.738013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ff1e9c9d-0653-4cee-bc40-980f98b65667 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1336 microversion: 2.20 time: 0.153161 Dec 08 11:31:37.740813 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 23/51] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:37 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1336 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:37.941717 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:37.954023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.317592 Dec 08 11:31:37.955745 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 29/52] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:37 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:37.967759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:37.968384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:37.979811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:37.980449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:37.981427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:37.981867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:38.089991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:38.090669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:38.097920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:38.098615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:38.099595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:38.100174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:38.391583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:38.402895 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.444302 Dec 08 11:31:38.406439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 24/53] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:37 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:38.609324 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:38.617042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-355e73dc-6c6a-4375-beba-55a8ea63158c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.533488 Dec 08 11:31:38.620152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 30/54] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:38 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:38.759033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:38.760488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:38.776111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:38.779242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:38.780220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:38.781989 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:38.972297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:38.974948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:38.982288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:38.982957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:38.984168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:38.984803 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:39.255431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:39.266501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:39.267994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:39.269130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d64329a7-6a25-4586-a911-427549a2017f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.514754 Dec 08 11:31:39.269975 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 25/55] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:38 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:39.330979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:39.355028 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-34127e28-c65d-4901-bc84-9065edc57746 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.386922 Dec 08 11:31:39.358004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 31/56] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:38 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:39.422955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:39.423588 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:39.436863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:39.438589 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:39.439418 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:39.439932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3fce56af-464b-4ca7-bb68-3581828d941d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:39.442330 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:39.442330 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:31:39.447309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:39.451225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3fce56af-464b-4ca7-bb68-3581828d941d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:39.461802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3fce56af-464b-4ca7-bb68-3581828d941d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:39.480434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3fce56af-464b-4ca7-bb68-3581828d941d service nova] Creating event network-changed:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:31:39.500384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3fce56af-464b-4ca7-bb68-3581828d941d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064370 Dec 08 11:31:39.501369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 32/57] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:31:39.638729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:39.639759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:39.651385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:39.654759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:39.658892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:39.665341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:40.176880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:40.183673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:40.186498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-288d544a-5286-4442-99af-2ff83963530c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.768165 Dec 08 11:31:40.192729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.558809 Dec 08 11:31:40.193335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 33/58] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:39 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:40.196008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 26/59] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:39 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:40.288386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:40.289053 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:40.298077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:40.302045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:40.303430 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:40.309018 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:40.375231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:40.376108 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:40.389516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:40.390067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:40.395190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:40.395929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:40.824427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:40.838582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9dbffce1-725a-4ec2-ba15-53b1121ce064 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.465788 Dec 08 11:31:40.846892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:40.849992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 27/60] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:40 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:40.856240 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:40.857993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:40.859294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-11d4ad6a-7fc3-4106-9537-c44ded012e0c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.576094 Dec 08 11:31:40.861951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 34/61] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:40 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:41.210062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:41.210855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:41.211512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:41.212565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:41.219160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.219624 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.220426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.220872 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.221442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.221906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.222695 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.223137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.575278 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:41.582741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.376673 Dec 08 11:31:41.585439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 28/62] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:41 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:41.598387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:41.606978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.400768 Dec 08 11:31:41.608136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 35/63] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:41 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:41.856773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:41.857407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:41.864907 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.865391 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.866264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.866703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.879960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:41.882174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:41.898718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.899582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:41.900712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:41.901414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:42.084667 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:42.092999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.239821 Dec 08 11:31:42.093609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 29/64] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:41 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:42.155861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:42.163924 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:42.165513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:42.167166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-181f6b32-c219-4d32-a9ba-f85abe627244 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.291178 Dec 08 11:31:42.168208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 36/65] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:41 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:31:42.604213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:42.604757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:42.611651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:42.612099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:42.621481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:42.623703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:42.626383 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:42.627973 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:42.644037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:42.646029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:42.648156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:42.648788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:42.955011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:42.958940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:42.974129 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.373934 Dec 08 11:31:42.980198 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 30/66] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:42 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:42.981875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-90aaecb0-7925-47a3-bfc6-9112936c9243 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.361145 Dec 08 11:31:42.993752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 37/67] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:42 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:43.109729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:43.110341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:43.118244 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:43.122690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:43.123830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:43.124501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:43.246056 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-6424d7e3-dc26-4825-be95-862cbfa7d29d req-3d8dd57b-0714-4740-a131-705d4b0844bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "name": "network-vif-plugged", "status": "completed", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:43.248799 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:43.248799 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:31:43.258173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-6424d7e3-dc26-4825-be95-862cbfa7d29d req-3d8dd57b-0714-4740-a131-705d4b0844bf service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:43.259173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-6424d7e3-dc26-4825-be95-862cbfa7d29d req-3d8dd57b-0714-4740-a131-705d4b0844bf service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:43.281420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-6424d7e3-dc26-4825-be95-862cbfa7d29d req-3d8dd57b-0714-4740-a131-705d4b0844bf service nova] Creating event network-vif-plugged:731fa8a4-e27d-4561-a86e-aa21c87548e7 for instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 on hv-cinder-81977 Dec 08 11:31:43.289398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-6424d7e3-dc26-4825-be95-862cbfa7d29d req-3d8dd57b-0714-4740-a131-705d4b0844bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306331 Dec 08 11:31:43.290224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 31/68] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:43.295940 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:43.296848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:43.303914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:43.304720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:43.306429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:43.307070 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:43.455530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:43.468268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.359147 Dec 08 11:31:43.470734 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 38/69] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:43 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:43.665512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:43.677413 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:43.679575 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:43.680730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-928931ec-b44e-4a82-be61-ba5326665553 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.389174 Dec 08 11:31:43.681331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 32/70] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:43 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:43.997943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:43.999446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:44.002340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:44.003148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:44.007223 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.007903 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.008870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.009977 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.017195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.017945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.019303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.020167 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.278372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:44.284275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:44.291867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b271f909-3e65-4964-9f68-b1178eb84246 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.295694 Dec 08 11:31:44.293100 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-861ab077-ab01-46ac-9264-7d4ea8d6af68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.300185 Dec 08 11:31:44.296259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 33/72] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:43 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:44.296405 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 39/72] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:43 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:44.496224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:44.496886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:44.504887 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.506270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.507445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.508459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.699258 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:44.700633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:44.704243 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:44.707061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.707743 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.708757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:44.709444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:44.716173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.223449 Dec 08 11:31:44.716966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 40/73] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:44 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:44.847906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:44.860733 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:44.862286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:44.863393 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a598212d-524e-47b4-8861-72f3dffc8830 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.167932 Dec 08 11:31:44.863948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 34/74] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:44 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:45.309977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:45.310157 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:45.310591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:45.310878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:45.316372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.317044 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.318025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.318614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.324808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.325424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.326339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.326962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.605939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:45.613624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:45.624915 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-563ec64d-6185-48ad-88bc-d897c5a4dde9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.316708 Dec 08 11:31:45.624915 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 41/75] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:45 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:45.627437 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-00a21927-d2aa-4a9a-baf2-7194eb5691cf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1363 microversion: 2.1 time: 0.321017 Dec 08 11:31:45.637932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5 req-34cdcec5-0cfc-4b9e-addd-f76e600232ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "name": "network-vif-plugged", "status": "completed", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3"}, {"server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "name": "network-vif-plugged", "status": "completed", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:45.638389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 35/76] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:45 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:45.640125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:45.640125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:31:45.648554 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5 req-34cdcec5-0cfc-4b9e-addd-f76e600232ae service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.649046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5 req-34cdcec5-0cfc-4b9e-addd-f76e600232ae service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.661868 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5 req-34cdcec5-0cfc-4b9e-addd-f76e600232ae service nova] Creating event network-vif-plugged:8e4b1127-3db2-4f93-a731-315192c060b3 for instance fe445662-9a2d-4c17-96ea-b054be927e53 on hv-cinder-81977 Dec 08 11:31:45.662431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5 req-34cdcec5-0cfc-4b9e-addd-f76e600232ae service nova] Creating event network-vif-plugged:d9ecab87-157e-4ccb-8423-2248bb8451ea for instance c7fa09fb-ae2b-4479-8848-f142131fe33a on hv-cinder-81977 Dec 08 11:31:45.669533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5 req-34cdcec5-0cfc-4b9e-addd-f76e600232ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043518 Dec 08 11:31:45.670149 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 42/77] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:45 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:45.732701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:45.733346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:45.739716 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.740449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.742076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.742661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.882794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:45.883848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:45.898119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.899586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:45.900766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:45.902539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:46.015915 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:46.031814 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7d16f269-ed85-49c2-aab0-0735296eab71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.302401 Dec 08 11:31:46.043838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 36/78] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:45 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:46.224169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:46.234592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:46.236515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:46.237879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9d454550-f6c9-4745-bf56-e3f9560397fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.360053 Dec 08 11:31:46.249079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 43/79] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:45 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:46.643175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:46.644074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:46.650941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:46.651496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:46.652366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:46.652879 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:46.657929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:46.658575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:46.688831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:46.689507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:46.694965 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:46.695441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:46.911436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:46.921686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.284212 Dec 08 11:31:46.931458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:46.931721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 37/80] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:46 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:46.939873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1548 microversion: 2.1 time: 0.298559 Dec 08 11:31:46.940464 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 44/81] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:46 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1548 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:46.957317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:46.957812 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:46.963707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:46.964148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:46.965117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:46.965721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.049610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:47.050234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:47.057587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.058336 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.061300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.061837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.122639 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168588 Dec 08 11:31:47.128920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 38/82] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Dec 8 11:31:46 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:47.229626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:47.236987 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1314 microversion: 2.1 time: 0.191039 Dec 08 11:31:47.240515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 45/83] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:47 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:47.255655 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:47.256276 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:47.262362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.263009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.263955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.264543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.421583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:47.431761 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:47.433298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:47.434622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6385ff62-b0e6-445b-ab15-e5b10c274522 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.182725 Dec 08 11:31:47.435488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 39/84] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:47 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:47.689561 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-97b9d02b-2af0-4206-9d3d-d8be961eddb3 req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:47.691506 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:47.691506 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:31:47.704533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-97b9d02b-2af0-4206-9d3d-d8be961eddb3 req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.708124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-97b9d02b-2af0-4206-9d3d-d8be961eddb3 req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.720802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-97b9d02b-2af0-4206-9d3d-d8be961eddb3 req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe service nova] Creating event network-vif-plugged:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:31:47.728538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-97b9d02b-2af0-4206-9d3d-d8be961eddb3 req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042967 Dec 08 11:31:47.729985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 46/85] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:47.938815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:47.939307 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:47.949096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.949581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:47.950455 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:47.950897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:48.255408 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:48.256302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:48.263755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:48.264492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:48.266032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:48.266968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:48.492869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:48.521425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c4d23ffc-873a-473f-a20b-99094ddf92d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1317 microversion: 2.1 time: 0.579513 Dec 08 11:31:48.534702 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 40/86] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:47 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:48.535795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:48.539851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:48.540463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:48.547603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:48.549120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:48.549120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:48.549120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:48.549922 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-25043bd9-594f-4e59-828f-9008168f5fc5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1501 microversion: 2.1 time: 0.298652 Dec 08 11:31:48.553306 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 47/87] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:48 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:48.821184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:48.837981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:48.840366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:48.847234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-08c1b829-7383-41fb-aefe-0c458d94b01b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.306081 Dec 08 11:31:48.858219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 41/88] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:48 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:49.352440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:49.354181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:49.359731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-baa46b30-6ef7-40e0-8162-852d4eebcd46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:49.361357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:49.361357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:31:49.385566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.387548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-baa46b30-6ef7-40e0-8162-852d4eebcd46 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.389207 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:49.389837 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-baa46b30-6ef7-40e0-8162-852d4eebcd46 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:49.390870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.393975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:49.432746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-baa46b30-6ef7-40e0-8162-852d4eebcd46 service nova] Creating event network-changed:731fa8a4-e27d-4561-a86e-aa21c87548e7 for instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 on hv-cinder-81977 Dec 08 11:31:49.460890 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-baa46b30-6ef7-40e0-8162-852d4eebcd46 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104493 Dec 08 11:31:49.470300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 42/89] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:49.542964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:49.544011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:49.557417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.562658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:49.565829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.570120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:49.681000 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3fc56a6f-0388-4df0-8de0-0a1927880a3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 14 microversion: 2.1 time: 0.333316 Dec 08 11:31:49.681982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 48/90] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:31:49 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 14 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:31:49.866878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:49.867590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:49.884617 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.885398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:49.886367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:49.886956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:50.097071 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:50.110560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1506 microversion: 2.1 time: 0.571450 Dec 08 11:31:50.111408 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 43/91] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:49 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:50.172658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c8c4ce2-260e-45a0-9167-a2f556c495cf"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:50.173767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:50.192692 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:50.197608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:50.200169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:50.200937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:50.225429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:50.233202 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:50.234701 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:50.235814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5b3fc320-5754-48cb-ba02-153988d5f52c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1404 microversion: 2.20 time: 0.373696 Dec 08 11:31:50.236366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 49/92] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:49 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1404 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:50.692054 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:50.693754 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:50.702854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:50.703331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:50.704127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:50.704559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:50.858968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-996e5bea-f151-466e-a230-115fb18d4f11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 14 microversion: 2.1 time: 0.170549 Dec 08 11:31:50.859851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 50/93] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:31:50 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 08 11:31:51.037871 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-531271bb-b207-4213-b123-9802788792a9 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "POST /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870244 Dec 08 11:31:51.040238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 44/94] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:31:50 2021] POST /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:51.254689 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:51.255411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:51.266788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:51.267248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:51.268048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:51.268489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:51.404077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:51.411930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:51.414067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:51.415187 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-91a1204f-4128-4a75-a46d-f7b4088bc6dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1596 microversion: 2.20 time: 0.165867 Dec 08 11:31:51.415739 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 51/95] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:31:51 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1596 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:31:51.434215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:51.434905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:51.445002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:51.445498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:51.446296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:51.446738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:51.533417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-12933a08-f722-44ae-aa16-2f89615b7cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103147 Dec 08 11:31:51.533937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 45/96] 10.222.0.66 () {60 vars in 1315 bytes} [Wed Dec 8 11:31:51 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:31:51.871014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:51.872826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:51.879234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:51.879677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:51.880457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:51.880949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:52.953027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:52.954170 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:52.960558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:52.961134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:52.962012 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:52.962520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:56.242758 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6d3bc1b7-da7a-41e2-9da1-c2e233a9d79d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 14 microversion: 2.20 time: 3.293781 Dec 08 11:31:56.246219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 46/97] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:31:52 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 14 bytes in 3295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:56.246344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-751ed528-2aaa-4567-8bd9-7c17e02c64b8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 14 microversion: 2.1 time: 4.379309 Dec 08 11:31:56.246944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 52/98] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:31:51 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 14 bytes in 4381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 08 11:31:56.249083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-b395e8c7-53d1-47ff-8e42-694b9c3644de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:56.250725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:31:56.250725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:31:56.259581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-b395e8c7-53d1-47ff-8e42-694b9c3644de service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:56.260032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-b395e8c7-53d1-47ff-8e42-694b9c3644de service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:56.271890 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-b395e8c7-53d1-47ff-8e42-694b9c3644de service nova] Creating event network-changed:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:31:56.277642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-b395e8c7-53d1-47ff-8e42-694b9c3644de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032774 Dec 08 11:31:56.278250 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 47/99] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:31:57.255716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:57.256768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:57.257776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:57.258995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:57.264661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:57.265173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:57.265273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:57.265658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:57.265988 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:57.266422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:57.266516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:57.266862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:57.347882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9a20d27e-4842-42d1-a89b-49a47d6be199 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 14 microversion: 2.20 time: 0.096728 Dec 08 11:31:57.348528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 53/100] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:31:57 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:31:57.355533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f3acc362-36dd-440b-9615-68ad04ce3c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 14 microversion: 2.1 time: 0.102005 Dec 08 11:31:57.356144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 48/101] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:31:57 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 08 11:31:57.593956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-36886986", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "1056c468-8569-46d3-ae01-3e9a87553272"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:57.643469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] validate_networks() for [('1056c468-8569-46d3-ae01-3e9a87553272', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:31:57.996699 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:31:57.997136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:31:57.997646 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:31:57.998315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:31:57.998730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:31:58.002588 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f347733-a06b-46b3-b30b-9114ff2a0bf6"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:58.003657 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:58.008049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.008498 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.009402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.009994 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.010674 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.011203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.012065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.012499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.029405 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Getting quotas for project bde1d456ccb0411eaed7cb4c5c07de7d. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:31:58.033255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Getting quotas for user 50e4404546cc4229b8b0a2cff9bb76e3 and project bde1d456ccb0411eaed7cb4c5c07de7d. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:31:58.043812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:31:58.046303 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:31:58.095703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506979 Dec 08 11:31:58.097458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 54/102] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:31:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:31:58.107276 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7a226ca7-977d-4d8e-91a5-fb4cdd569aca tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:31:58.108284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7a226ca7-977d-4d8e-91a5-fb4cdd569aca tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:58.187057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7a226ca7-977d-4d8e-91a5-fb4cdd569aca tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:31:58.196980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7a226ca7-977d-4d8e-91a5-fb4cdd569aca tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1212 microversion: 2.1 time: 0.093041 Dec 08 11:31:58.198124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 55/103] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:31:58 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:31:58.358917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:58.366697 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:58.368598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.369102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.369997 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.370689 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.379592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7a5b96ab-549b-484a-9d4f-ff34c2abff2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380723 Dec 08 11:31:58.380558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 49/104] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:31:57 2021] POST /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:31:58.392151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:31:58.393540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:31:58.401931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.402622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:31:58.403746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:31:58.404381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:03.703437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fdc18fee-7a87-4006-8c3f-8e5d9a62858d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 14 microversion: 2.20 time: 5.348240 Dec 08 11:32:03.704313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 56/105] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:31:58 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 14 bytes in 5350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:32:03.709878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:03.710897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:03.720256 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:03.720712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:03.721528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:03.721989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:03.743358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-138200bd-dc71-4d09-959f-565127054fb3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 15025 microversion: 2.1 time: 5.356256 Dec 08 11:32:03.744791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 50/106] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:31:58 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 15025 bytes in 5358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:03.782844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:03.790345 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-29890754-485c-42aa-a3bb-d4e9102f5bea tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1216 microversion: 2.1 time: 0.084430 Dec 08 11:32:03.791046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 57/107] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:03 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:04.715301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:04.716294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:04.724108 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:04.724561 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:04.725434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:04.725875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:04.755976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:04.757603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:04.764012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:04.764670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:04.765493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:04.765931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:04.795911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b986bed8-b82f-4a11-81e3-cfeff46e5542 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 14 microversion: 2.20 time: 0.084480 Dec 08 11:32:04.796712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 51/108] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:04 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:04.807807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:04.808511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:04.815574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:04.816033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:04.816817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:04.818055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:04.857309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-379befc4-386e-447b-8d7a-80cd9913d597 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 17861 microversion: 2.1 time: 0.106156 Dec 08 11:32:04.861070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 58/109] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:04 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 17861 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:32:04.914916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:04.922300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fb632558-5427-457c-8245-2d2cf5afff91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1270 microversion: 2.1 time: 0.118365 Dec 08 11:32:04.922865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 52/110] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:04 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:32:05.662999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f2632e76-b375-41a5-866d-30131b3a5f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:05.664729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:32:05.664729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:32:05.673870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f2632e76-b375-41a5-866d-30131b3a5f8c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.674322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f2632e76-b375-41a5-866d-30131b3a5f8c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.685423 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f2632e76-b375-41a5-866d-30131b3a5f8c service nova] Creating event network-changed:fdf2c7c1-363c-4a60-b59f-a320f77b0e66 for instance d60041b9-3a0a-495a-aaa8-0da5f57e7e42 on hv-cinder-81977 Dec 08 11:32:05.690802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f2632e76-b375-41a5-866d-30131b3a5f8c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Dec 08 11:32:05.691403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 59/111] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:32:05.808048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:05.809028 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:05.815057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.815507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.816291 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.816728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.870370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:05.873085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:05.878731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.879181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.879963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.880414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.908809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9c4d4170-e56f-464c-b390-3ae3ec91b140 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 14 microversion: 2.20 time: 0.105624 Dec 08 11:32:05.910481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 53/112] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:05 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:05.938305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:05.939008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:05.945841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.946292 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.947083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:05.947523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:05.985419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cbb7d663-1bae-409c-a3e5-7928a67e6146 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 18663 microversion: 2.1 time: 0.120144 Dec 08 11:32:05.986045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 60/113] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:05 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 18663 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:06.165264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:06.172577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-789c4027-7176-47c7-afc1-6593c1002931 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.238187 Dec 08 11:32:06.173143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 54/114] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:05 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:32:06.921024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:06.921962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:06.929465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:06.930004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:06.930830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:06.931275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:06.997381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:06.998322 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:07.004356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:07.004792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:07.005593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:07.006734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:07.123993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b9d83745-7644-4f65-a7a2-243164499d56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 19775 microversion: 2.1 time: 0.130086 Dec 08 11:32:07.127639 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 55/115] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:06 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 19775 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:32:07.141599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fd0dafc7-644a-467f-b7c3-3bff23ecbf88 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 4107 microversion: 2.20 time: 0.224473 Dec 08 11:32:07.142270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 61/116] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:06 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 4107 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:32:07.189378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:07.190156 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:07.197008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:07.197485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:07.198259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:07.198694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:07.329259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:07.336896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e0002538-d5b5-4ed5-8738-47a4fe27469a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.151467 Dec 08 11:32:07.337514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 56/117] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:07 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:08.136230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:08.137266 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:08.144056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:08.144760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:08.145586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:08.146019 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:08.153883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:08.154855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:08.161036 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:08.161520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:08.162817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:08.163247 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:08.257482 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-98ef856f-da7e-43af-b7d1-bce5e992ed6a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 21482 microversion: 2.1 time: 0.124962 Dec 08 11:32:08.258831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 62/118] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:08 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 21482 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:08.292017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d5bca28d-e34e-4669-b955-127c419c3805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 7914 microversion: 2.20 time: 0.141494 Dec 08 11:32:08.292821 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 57/119] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:08 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 7914 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:32:08.353768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:08.354465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:08.364388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:08.364841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:08.365669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:08.366094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:08.490422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:08.498460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2265bdb5-a27c-484b-ad7d-a1f737b9189a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.149201 Dec 08 11:32:08.499012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 63/120] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:08 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:09.270043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:09.270820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:09.277838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:09.278294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:09.279088 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:09.279523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:09.307956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:09.308875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:09.315477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:09.315915 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:09.316693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:09.317121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:09.782168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cb23c3d5-4b06-422a-b40f-44c3c604b127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 22882 microversion: 2.1 time: 0.517062 Dec 08 11:32:09.786064 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 58/121] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:09 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 22882 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:09.788474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:09.789173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:09.795998 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:09.796473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:09.797259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:09.797690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:09.827387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1dbcefee-e306-409c-b8a0-10a5c04abc46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 15025 microversion: 2.20 time: 0.526482 Dec 08 11:32:09.828030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 64/122] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:09 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 15025 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:09.931471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:09.938959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-498379d4-b3ab-442d-90c6-d37fe2641b66 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.154765 Dec 08 11:32:09.939600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 59/123] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:09 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:10.794163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:10.795176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:10.801981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:10.802436 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:10.803746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:10.804184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:10.839190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:10.840126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:10.855097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:10.855560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:10.856345 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:10.856992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:14.292489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-992fbe0e-6222-41c4-ae98-96e4a1c3f4d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 25163 microversion: 2.1 time: 3.502136 Dec 08 11:32:14.293904 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 65/124] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:10 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 25163 bytes in 3505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:14.303567 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:14.304549 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:14.312278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:14.312976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:14.314160 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:14.314755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:14.531678 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:14.557706 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.258819 Dec 08 11:32:14.558508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 66/125] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:14 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:14.722089 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cc451945-5c66-4239-b5c9-01690902247b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 19617 microversion: 2.20 time: 3.885473 Dec 08 11:32:14.728230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 60/126] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:10 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 19617 bytes in 3893 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:15.304668 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:15.305628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:15.320947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:15.322168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:15.323450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:15.324300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:15.423198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-041afc9a-a5c1-4005-9b94-b3d942f6ede8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 26154 microversion: 2.1 time: 0.122651 Dec 08 11:32:15.423829 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 67/127] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:15 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 26154 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:15.575854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:15.576740 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:15.589255 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:15.589713 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:15.590513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:15.593018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:15.737515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:15.738941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:15.746788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:15.747521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:15.748762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:15.753471 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:16.010188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:16.020659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.448874 Dec 08 11:32:16.022308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 61/128] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:15 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:16.027331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-14447ce2-b3fb-403a-8ddd-9c597598144f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 22706 microversion: 2.20 time: 0.295902 Dec 08 11:32:16.032419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 68/129] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:15 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 22706 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:32:16.434429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:16.435444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:16.444182 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:16.444718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:16.445597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:16.446095 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:16.535584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5cca3202-e435-41b0-9fb4-b0194fe9d5a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 26846 microversion: 2.1 time: 0.104254 Dec 08 11:32:16.537437 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 62/130] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:16 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 26846 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:17.038685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:17.039395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:17.040753 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:17.042303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:17.053482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:17.054116 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:17.055095 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:17.055749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:17.058407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:17.059631 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:17.060685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:17.062816 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:17.207194 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-600416ff-1e51-4f18-b563-092fbd5a13e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 23793 microversion: 2.20 time: 0.170532 Dec 08 11:32:17.210816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 63/131] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:17 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 23793 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:32:17.221945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:17.230267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7b3c00fc-c196-456a-97cd-21b5b3b60aae tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.196127 Dec 08 11:32:17.230836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 69/132] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:17 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:17.549252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:17.550545 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:17.558893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:17.559346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:17.560196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:17.560636 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:17.658688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-60fa26e8-9cee-492a-9499-4a67366abfd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 27133 microversion: 2.1 time: 0.114117 Dec 08 11:32:17.659524 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 64/133] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:17 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 27133 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:18.222161 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:18.223319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:18.234644 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.235561 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.236706 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.237356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.248565 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:18.249480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:18.265381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.268308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.269417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.273766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.343575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1108f7be-299b-4699-b628-03af900f8b9a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 24602 microversion: 2.20 time: 0.127050 Dec 08 11:32:18.345057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 70/134] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:18 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 24602 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:18.594919 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:18.604136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9f9931cd-fc86-4744-9045-b94bfaf18ffc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.360784 Dec 08 11:32:18.605738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 65/135] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:18 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:18.672472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:18.673759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:18.681192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.681886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.682737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.683267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.785672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-38c567f4-5dff-4ebf-88fd-044d175fe2d3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 27571 microversion: 2.1 time: 0.117712 Dec 08 11:32:18.787791 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 71/136] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:18 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 27571 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:18.968038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:18.968641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:18.975411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.976146 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:18.977180 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:18.977768 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.004532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:32:19.117977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-19244556-2b86-49b0-abb9-fe76a139e6a2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 204 len: 0 microversion: 2.1 time: 0.153379 Dec 08 11:32:19.124973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 66/137] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:32:18 2021] DELETE /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:32:19.129065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:19.129859 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:19.137176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.138035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.139526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.139968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.317455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:19.331128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1553 microversion: 2.1 time: 0.206054 Dec 08 11:32:19.343388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 72/138] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:19 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:32:19.356896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:19.357958 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:19.373305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.373779 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.374620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.375062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.529436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-60905014-079f-4718-9910-5bd542076060 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 25334 microversion: 2.20 time: 0.177598 Dec 08 11:32:19.530357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 67/139] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:19 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 25334 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:19.622156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:19.623496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:19.633844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.634510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.640671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.641991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.650738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-626dcbb1-c6fc-46d9-adfe-256ec9341184 req-a4345c08-1024-45ea-abd8-521e0775d91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "name": "network-vif-plugged", "status": "completed", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:19.653961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:32:19.653961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:32:19.688033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-626dcbb1-c6fc-46d9-adfe-256ec9341184 req-a4345c08-1024-45ea-abd8-521e0775d91f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.688856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-626dcbb1-c6fc-46d9-adfe-256ec9341184 req-a4345c08-1024-45ea-abd8-521e0775d91f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.730298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-626dcbb1-c6fc-46d9-adfe-256ec9341184 req-a4345c08-1024-45ea-abd8-521e0775d91f service nova] Creating event network-vif-plugged:fdf2c7c1-363c-4a60-b59f-a320f77b0e66 for instance d60041b9-3a0a-495a-aaa8-0da5f57e7e42 on hv-cinder-81977 Dec 08 11:32:19.755579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-626dcbb1-c6fc-46d9-adfe-256ec9341184 req-a4345c08-1024-45ea-abd8-521e0775d91f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110223 Dec 08 11:32:19.757263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 68/140] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:32:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:32:19.799068 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:19.800097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:19.828651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.829104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.829946 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:19.830388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:19.943653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:19.955246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5a60b570-9e15-447d-b6e3-faff1c5ca631 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.337155 Dec 08 11:32:19.955826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 73/141] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:19 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:20.009101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b06a08aa-ab4c-4585-8ffe-1f07379dc97a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 27756 microversion: 2.1 time: 0.213870 Dec 08 11:32:20.010420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 69/142] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:19 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 27756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:32:20.350817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:20.351602 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:20.360812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:20.364599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:20.366104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:20.366793 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:20.545592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:20.546809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:20.567009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:20.567461 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:20.572302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:20.578414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:20.827647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a808a763-bdb9-45e0-8c31-902b5d9d60bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 26118 microversion: 2.20 time: 0.288326 Dec 08 11:32:20.828307 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 70/143] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:20 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 26118 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:20.928951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:20.944931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1553 microversion: 2.1 time: 0.597724 Dec 08 11:32:20.959057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 74/144] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:20 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1553 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:20.985294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:20.986652 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:20.995214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:20.996083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:20.997214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:20.998083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:21.022300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:21.023450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:21.039771 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:21.040905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:21.043931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:21.045416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:21.214443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-33fa474a-ff34-49e0-a611-716319e12f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 27979 microversion: 2.1 time: 0.196820 Dec 08 11:32:21.215101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 75/145] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:21 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 27979 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:21.327916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:21.336746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-098fda69-fddf-4921-b4ba-624e8d064e9a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1312 microversion: 2.1 time: 0.368444 Dec 08 11:32:21.337392 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 71/146] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:20 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:21.840791 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:21.842804 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:21.857022 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:21.860291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:21.861556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:21.862860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:21.979314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:21.979977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:22.008072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:22.015891 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:22.018966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:22.020411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:22.118664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b8e94a13-bb69-487c-8075-068af50a1637 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 26697 microversion: 2.20 time: 0.281060 Dec 08 11:32:22.119550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 76/147] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:21 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 26697 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:22.230774 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:22.232493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:22.257606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:22.258057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:22.277262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:22.277725 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:22.457985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-67809c47-5428-44ae-a9b1-debf7b5f682e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.233582 Dec 08 11:32:22.460083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 77/148] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:22 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:22.473787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:22.475471 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:22.503438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:22.505106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:22.520723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:22.526500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:22.529992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:22.545237 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1553 microversion: 2.1 time: 0.572962 Dec 08 11:32:22.547220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 72/149] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:21 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1553 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:32:22.846191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:22.856027 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-70136959-08e7-4323-b582-a13034eeb407 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1497 microversion: 2.1 time: 0.394713 Dec 08 11:32:22.859387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 78/150] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:22 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1497 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:23.132650 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:23.133866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:23.153519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.155733 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.159806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.161077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.329619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-15bd6469-357c-4260-8256-93c37ad88856 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 27167 microversion: 2.20 time: 0.202012 Dec 08 11:32:23.330271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 73/151] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:23 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 27167 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:23.478049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:23.484540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:23.499211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.500093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.501200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.501943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.574995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:23.575727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:23.583193 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.585371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.586323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.586960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.591937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ba2b25dd-ba2b-4fa6-b1be-01a5b86031b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.124380 Dec 08 11:32:23.594089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 79/152] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:23 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:23.651939 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:23.652532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:23.666329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.667063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.668908 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.669920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.716325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:32:23.867166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-60f8dc83-9048-4776-83b4-b8cce7160591 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 204 len: 0 microversion: 2.1 time: 0.221403 Dec 08 11:32:23.869292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 80/153] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:32:23 2021] DELETE /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:32:23.882042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:23.883374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:23.907055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.908001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:23.914348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:23.915128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:24.074355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:24.082750 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1553 microversion: 2.1 time: 0.521879 Dec 08 11:32:24.096856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 74/154] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:23 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1553 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:24.342293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:24.343719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:24.356678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:24.357136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:24.357945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:24.358561 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:24.527124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:24.539135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a81c575f-416b-4906-9abc-4fab6a32912c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1503 microversion: 2.1 time: 0.661035 Dec 08 11:32:24.540638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 81/155] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:23 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1503 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:24.547642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-d5333973-feed-4944-a365-c741fdacc820 req-669e9102-2916-4141-bc97-2bde8facb165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "name": "network-vif-deleted", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:24.557121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-acf32a95-b880-4501-a993-7918e79bedb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 27451 microversion: 2.20 time: 0.218640 Dec 08 11:32:24.558925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 75/156] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:24 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 27451 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:24.560564 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:32:24.560564 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:32:24.581688 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-d5333973-feed-4944-a365-c741fdacc820 req-669e9102-2916-4141-bc97-2bde8facb165 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:24.582593 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-d5333973-feed-4944-a365-c741fdacc820 req-669e9102-2916-4141-bc97-2bde8facb165 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:24.615358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:24.620904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:24.645311 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:24.645852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:24.649089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-d5333973-feed-4944-a365-c741fdacc820 req-669e9102-2916-4141-bc97-2bde8facb165 service nova] Creating event network-vif-deleted:8e4b1127-3db2-4f93-a731-315192c060b3 for instance fe445662-9a2d-4c17-96ea-b054be927e53 on hv-cinder-81977 Dec 08 11:32:24.652003 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:24.652450 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:24.670720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-d5333973-feed-4944-a365-c741fdacc820 req-669e9102-2916-4141-bc97-2bde8facb165 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124432 Dec 08 11:32:24.676203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 82/157] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:32:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:32:24.792007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6a948ce7-7f70-4252-9cc6-506e3203ec6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.186612 Dec 08 11:32:24.793249 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 76/158] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:24 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:32:25.115533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:25.116955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:25.130519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.131223 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.132823 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.134057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.197185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.197818 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.198444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lazy-loading 'fault' on Instance uuid fe445662-9a2d-4c17-96ea-b054be927e53 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:32:25.266255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a52dcd9f0b4ce2979b31773725ca07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:25.276606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 200 len: 1350 microversion: 2.1 time: 0.166025 Dec 08 11:32:25.292520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 83/159] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:25 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 1350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:25.558575 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:25.559949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:25.570639 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:25.571703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:25.575987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.578519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.579924 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.580577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.581611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.584670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.602544 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.603338 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.745271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b61f36e3-caf3-4b81-a8d7-9ae95826ec95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 27615 microversion: 2.20 time: 0.178855 Dec 08 11:32:25.746274 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 84/160] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:25 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 27615 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:25.804916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:25.805721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:25.824210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.824669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.825516 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:25.825959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:25.971378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:25.985808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1503 microversion: 2.1 time: 0.431323 Dec 08 11:32:25.987863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 77/161] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:25 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1503 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:25.988783 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-89689a91-5f47-4df3-b340-964d7810cef4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.188929 Dec 08 11:32:25.989503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 85/162] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:25 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:32:26.176389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1951681774", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "6e4bda07-1ae1-4be4-bf28-e94211f51919"}]}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:26.295096 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:26.297193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:26.312961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:26.316660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:26.317837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:26.319003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:26.349920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] HTTP exception thrown: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. Dec 08 11:32:26.365558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Returning 404 to user: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:32:26.373127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-413859a7-a80e-4a71-8cc7-56226b67f714 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 404 len: 111 microversion: 2.1 time: 0.081613 Dec 08 11:32:26.378350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 86/163] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:26 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:32:26.626032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:26.626972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:26.638493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:26.639247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:26.640077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:26.640520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:26.707061 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] HTTP exception thrown: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. Dec 08 11:32:26.707677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Returning 404 to user: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:32:26.709138 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-26b80fad-8f95-4f55-b058-45100c9bc0d2 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.090878 Dec 08 11:32:26.709933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 87/164] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:32:26 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:32:26.758601 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:26.762158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:26.775937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:26.777251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:26.778319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:26.778971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:26.927051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dc0d2315-6362-4a9d-822e-0afd09baf23b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 27939 microversion: 2.20 time: 0.172670 Dec 08 11:32:26.932144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 88/165] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:26 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 27939 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:27.010214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:27.011406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:27.047037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.052982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:27.054063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.054667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:27.164505 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b6e29d2b-2bdf-4c57-8847-ad4f4c827d12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.163353 Dec 08 11:32:27.165905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 89/166] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:26 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:27.173473 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:27.176715 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:27.195922 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.196366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:27.197189 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.197616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:27.316440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:27.330883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 200 len: 1461 microversion: 2.1 time: 0.163491 Dec 08 11:32:27.331465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 90/167] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:27 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 1461 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:27.354045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-5d887361-ba10-47bc-9b53-2271a83bf849 req-bb970da9-8471-4776-b269-cdd02114d49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "name": "network-vif-deleted", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:27.364248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:32:27.364248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:32:27.397954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-5d887361-ba10-47bc-9b53-2271a83bf849 req-bb970da9-8471-4776-b269-cdd02114d49a service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.398895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-5d887361-ba10-47bc-9b53-2271a83bf849 req-bb970da9-8471-4776-b269-cdd02114d49a service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:27.419600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-5d887361-ba10-47bc-9b53-2271a83bf849 req-bb970da9-8471-4776-b269-cdd02114d49a service nova] Creating event network-vif-deleted:fdf2c7c1-363c-4a60-b59f-a320f77b0e66 for instance d60041b9-3a0a-495a-aaa8-0da5f57e7e42 on hv-cinder-81977 Dec 08 11:32:27.428909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-5d887361-ba10-47bc-9b53-2271a83bf849 req-bb970da9-8471-4776-b269-cdd02114d49a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092090 Dec 08 11:32:27.429771 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 91/168] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:32:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:32:27.939905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:27.946942 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:27.961183 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.961645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:27.963776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:27.964235 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.078989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-95ffb0fc-fd7c-4b6e-9d02-fbae67a06e71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28174 microversion: 2.20 time: 0.144092 Dec 08 11:32:28.079624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 92/169] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:27 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28174 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:32:28.128693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:28.129486 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:28.150736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.152509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.153692 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.154743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.209823 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] HTTP exception thrown: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. Dec 08 11:32:28.211154 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Returning 404 to user: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:32:28.215289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b64bc75b-7b7e-49a9-a98f-afcf1d31141b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 404 len: 111 microversion: 2.1 time: 0.090593 Dec 08 11:32:28.216583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 93/170] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:32:28 2021] DELETE /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 08 11:32:28.247580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:28.248718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:28.266626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.268228 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.270187 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.270674 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.374241 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2fad4586-5a67-4734-9cb1-abf6456e932c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.154923 Dec 08 11:32:28.374877 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 94/171] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:28 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:28.385133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:28.389021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] [instance: fe445662-9a2d-4c17-96ea-b054be927e53] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:28.397071 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.397804 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.398850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.399521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.423895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] HTTP exception thrown: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. Dec 08 11:32:28.424761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Returning 404 to user: Instance fe445662-9a2d-4c17-96ea-b054be927e53 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:32:28.425814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-218d168d-df74-4d3f-b53a-ea11b29fe0cc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53" status: 404 len: 111 microversion: 2.1 time: 0.049880 Dec 08 11:32:28.426861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 95/172] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:28 2021] GET /compute/v2.1/servers/fe445662-9a2d-4c17-96ea-b054be927e53 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:32:28.460250 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:28.461256 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: d60041b9-3a0a-495a-aaa8-0da5f57e7e42] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:28.475755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.482410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.483548 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:28.488599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:28.533510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] HTTP exception thrown: Instance d60041b9-3a0a-495a-aaa8-0da5f57e7e42 could not be found. Dec 08 11:32:28.534138 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Returning 404 to user: Instance d60041b9-3a0a-495a-aaa8-0da5f57e7e42 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:32:28.534990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5511c4e9-fada-4b8e-8b75-2c4bfb4f7e23 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42" status: 404 len: 111 microversion: 2.1 time: 0.106364 Dec 08 11:32:28.535550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 96/173] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:28 2021] GET /compute/v2.1/servers/d60041b9-3a0a-495a-aaa8-0da5f57e7e42 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:32:28.762934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-609661375", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "1056c468-8569-46d3-ae01-3e9a87553272"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:36.339596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] validate_networks() for [('6e4bda07-1ae1-4be4-bf28-e94211f51919', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:32:36.343291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] validate_networks() for [('1056c468-8569-46d3-ae01-3e9a87553272', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:32:36.990021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:32:36.990517 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:32:36.990936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:32:36.991053 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:32:36.991498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:32:36.991883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:32:36.992007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:32:36.992299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:32:36.992705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:32:36.993372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:32:37.001344 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.001803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.002611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.003046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.016032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.016750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.017680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.018317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.019635 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:37.024959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for user 3d93916bc3fd40fb8f60f9b7a592a29f and project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:37.038317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:32:37.038454 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Getting quotas for project bde1d456ccb0411eaed7cb4c5c07de7d. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:37.040775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:32:37.043004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Getting quotas for user 50e4404546cc4229b8b0a2cff9bb76e3 and project bde1d456ccb0411eaed7cb4c5c07de7d. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:37.055281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:32:37.057644 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:32:37.091121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f683c32a-587c-4e27-b696-0d3784ffbc1d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.919002 Dec 08 11:32:37.092295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 78/174] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:32:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 10921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:32:37.103091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:37.104361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:37.115983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.116839 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.117882 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.118283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.151502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6cd14e8c-cace-454f-9feb-78c2b371fad2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.398857 Dec 08 11:32:37.152781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 97/175] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:32:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 8401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:32:37.163434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:37.164640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:37.183935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.184587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.185587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:37.186659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:37.205804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ad4bb758-14da-4406-a8d5-4833ea538398 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28174 microversion: 2.20 time: 0.111921 Dec 08 11:32:37.211421 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 79/176] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:37 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28174 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:37.260148 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8c2da80a-cd20-4835-84a1-05db4fb5ee62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.105843 Dec 08 11:32:37.261095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 98/177] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:37 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:37.274135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f3363b6d-0cf9-452f-99af-1a7a27ca7897 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Action: 'create', calling method: .version_select at 0x7f1fa684cdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-962986123"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:37.316907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-f3363b6d-0cf9-452f-99af-1a7a27ca7897 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Getting quotas for project 3102b9c0f7ea45048750ae3c81085631. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:37.325714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-f3363b6d-0cf9-452f-99af-1a7a27ca7897 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Getting quotas for user 101fe00a724249e4bf2d3c98224142f6 and project 3102b9c0f7ea45048750ae3c81085631. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:37.537719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-322690720", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b799b290-99c1-4693-82cc-42bbd4d90adb"}]}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:37.540932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-f3363b6d-0cf9-452f-99af-1a7a27ca7897 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Getting quotas for project 3102b9c0f7ea45048750ae3c81085631. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:37.548614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-f3363b6d-0cf9-452f-99af-1a7a27ca7897 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Getting quotas for user 101fe00a724249e4bf2d3c98224142f6 and project 3102b9c0f7ea45048750ae3c81085631. Resources: {'key_pairs'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:37.567206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f3363b6d-0cf9-452f-99af-1a7a27ca7897 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.299640 Dec 08 11:32:37.568519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 99/178] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Dec 8 11:32:37 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:37.594762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-71e874ef-b265-4ea7-b62a-283b2b35ea27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:37.596545 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-71e874ef-b265-4ea7-b62a-283b2b35ea27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:37.633823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] validate_networks() for [('b799b290-99c1-4693-82cc-42bbd4d90adb', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:32:37.732543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-71e874ef-b265-4ea7-b62a-283b2b35ea27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:37.740293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-71e874ef-b265-4ea7-b62a-283b2b35ea27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1218 microversion: 2.1 time: 0.170357 Dec 08 11:32:37.744348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 100/179] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:37 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:37.752481 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2072a5fe-4616-43b9-9044-a8f6bab53dc1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:37.753406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2072a5fe-4616-43b9-9044-a8f6bab53dc1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:37.895529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2072a5fe-4616-43b9-9044-a8f6bab53dc1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:37.904047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2072a5fe-4616-43b9-9044-a8f6bab53dc1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1213 microversion: 2.1 time: 0.158021 Dec 08 11:32:37.904774 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 101/180] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:37 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:37.910462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-629059621", "imageRef": "51823034-ff56-4f2b-8059-8c7ac949514a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-962986123", "networks": [{"uuid": "f5a54297-6b64-4f71-b9f2-2f9c14a03187"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:37.980049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] validate_networks() for [('f5a54297-6b64-4f71-b9f2-2f9c14a03187', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:32:38.308895 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:32:38.309602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:32:38.310368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:32:38.310789 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:32:38.311256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:32:38.331968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.332429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.334143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.334654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.355328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Getting quotas for project 801ccccb4d7647de8e9558e07ebdc070. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:38.360103 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Getting quotas for user 3919341ead9c45f6b65805b93b7aab32 and project 801ccccb4d7647de8e9558e07ebdc070. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:38.372695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:32:38.376252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:32:38.439331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bad59d13-96fa-4d64-b0de-b71c215076c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.226583 Dec 08 11:32:38.441305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 80/181] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:32:37 2021] POST /compute/v2.1/servers => generated 383 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:32:38.463139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:38.464829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:38.491204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.491670 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.495099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.495901 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.592398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7df5e332-3543-4bac-a4c5-3704fe995c3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28174 microversion: 2.20 time: 0.145216 Dec 08 11:32:38.597797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 81/182] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:38 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28174 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:38.605256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:38.608866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:38.654778 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.656177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.657402 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.657906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.743442 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e5bf1837-e422-457a-bfa4-901f3ea60127 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.143853 Dec 08 11:32:38.744199 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 82/183] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:38 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:38.759399 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c36c091b-e270-4910-9e42-6d3bac66e54e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:38.760243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c36c091b-e270-4910-9e42-6d3bac66e54e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:38.881563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c36c091b-e270-4910-9e42-6d3bac66e54e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:38.893685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c36c091b-e270-4910-9e42-6d3bac66e54e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1221 microversion: 2.1 time: 0.137914 Dec 08 11:32:38.898859 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:32:38.899329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:32:38.899749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:32:38.900155 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:32:38.900616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:32:38.902700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 83/184] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:38 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1221 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:38.915639 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:38.915790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.916249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.917172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.917620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.921446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:38.952908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.952908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.952908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:38.956532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:38.991180 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Getting quotas for project 3102b9c0f7ea45048750ae3c81085631. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:39.004723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Getting quotas for user 101fe00a724249e4bf2d3c98224142f6 and project 3102b9c0f7ea45048750ae3c81085631. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:39.035311 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:32:39.042264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51823034-ff56-4f2b-8059-8c7ac949514a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:32:39.084835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:39.107525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1276 microversion: 2.1 time: 0.203789 Dec 08 11:32:39.112111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 84/185] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:38 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:39.134414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:39.135868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:39.143648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-381bc50d-c9ba-4c40-aa42-94e243128516 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237038 Dec 08 11:32:39.144594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 102/186] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:32:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:32:39.152709 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:39.153346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:39.155943 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:39.157127 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:39.179509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1777824770", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b799b290-99c1-4693-82cc-42bbd4d90adb"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:39.283374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] validate_networks() for [('b799b290-99c1-4693-82cc-42bbd4d90adb', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:32:39.374162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:39.381714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-34a92e38-d11b-4acb-810c-f1365d8b7b51 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1283 microversion: 2.1 time: 0.266059 Dec 08 11:32:39.383342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 85/187] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:39 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:39.388033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7ea43af8-5e7b-4501-86b1-0160c85277e4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:39.388851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7ea43af8-5e7b-4501-86b1-0160c85277e4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:39.545144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7ea43af8-5e7b-4501-86b1-0160c85277e4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:39.581026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7ea43af8-5e7b-4501-86b1-0160c85277e4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1257 microversion: 2.1 time: 0.196465 Dec 08 11:32:39.582444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 86/188] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:39 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1257 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:39.605135 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:39.606875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:39.617374 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:39.617833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:39.618634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:39.619229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:39.735251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f7182520-0efe-40b1-b997-5f1b917fd176 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28174 microversion: 2.20 time: 0.133441 Dec 08 11:32:39.740163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 87/189] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:39 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28174 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:39.757911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:39.759866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:39.769779 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:39.771248 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:39.772411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:39.773210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:39.872190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e5a111ae-d376-4a61-8c6b-ca9aec968134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.119725 Dec 08 11:32:39.874804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 88/190] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:39 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:32:40.128701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:40.129436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:40.137240 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:40.137739 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:40.138538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:40.138973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.002477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:41.022265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2aefc658-d966-4e66-a21f-6d7d714d8b1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.897134 Dec 08 11:32:41.035079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 89/191] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:40 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:32:41.040085 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:41.040697 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:41.047217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.047664 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.048466 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.048932 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.164156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:32:41.164702 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:32:41.166268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:32:41.166875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:32:41.168377 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:32:41.183795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.184490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.185690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.186465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.213692 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Getting quotas for project 801ccccb4d7647de8e9558e07ebdc070. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:32:41.218086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Getting quotas for user 3919341ead9c45f6b65805b93b7aab32 and project 801ccccb4d7647de8e9558e07ebdc070. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:32:41.229932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:32:41.232748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:32:41.315214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.152838 Dec 08 11:32:41.324135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 103/192] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:32:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:32:41.334013 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:41.335563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:41.349545 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.351194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.352746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.354708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.494950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:41.518854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-91cc82de-92d5-4945-bf0f-8972672795d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1315 microversion: 2.1 time: 0.192549 Dec 08 11:32:41.521645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 104/193] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:41 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:41.537429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:41.538808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:41.540166 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:41.548389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3ddbec2e-3288-4090-abcb-57e4e789a449 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.512048 Dec 08 11:32:41.550617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 90/194] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:41 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:41.554216 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.555232 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.560280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.562383 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.570727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:41.573604 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:41.590853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.592212 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.593801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.594385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.651807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f7d3804d-0c59-4907-9fd4-48c2c7481a37 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28174 microversion: 2.20 time: 0.127457 Dec 08 11:32:41.652788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 105/195] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:41 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28174 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:32:41.661337 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b56f2724-428d-4771-9eb5-87f15658188c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:41.662043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b56f2724-428d-4771-9eb5-87f15658188c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:41.720125 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b52ec10e-2047-49ef-8bff-256976342244 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28178 microversion: 2.1 time: 0.167195 Dec 08 11:32:41.720914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 91/196] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:41 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28178 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:32:41.732913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-913bf354-d50f-4566-a67d-20b32703400f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:41.745269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:32:41.745269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:32:41.758925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-913bf354-d50f-4566-a67d-20b32703400f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:41.764917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-913bf354-d50f-4566-a67d-20b32703400f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:41.803414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-913bf354-d50f-4566-a67d-20b32703400f service nova] Creating event network-changed:6487232e-a2f6-40ee-bcd9-a49395653c34 for instance 3c255cd4-9751-4e4f-883b-9399d6a8c37e on hv-cinder-81977 Dec 08 11:32:41.819361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-913bf354-d50f-4566-a67d-20b32703400f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092075 Dec 08 11:32:41.823751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 92/197] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:32:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:32:41.824808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b56f2724-428d-4771-9eb5-87f15658188c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:41.832333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b56f2724-428d-4771-9eb5-87f15658188c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1222 microversion: 2.1 time: 0.178310 Dec 08 11:32:41.832979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 106/198] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:41 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:42.042750 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:42.043566 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:42.054809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:42.057618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:42.062394 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:42.063160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:42.540606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:42.541251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:42.562966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:42.563621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:42.564608 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:42.565314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:42.597241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:42.608800 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a1d08d2b-8a68-410c-a99f-08d0f47e646a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.571592 Dec 08 11:32:42.619482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 93/199] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:42 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:42.619482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:32:42.619482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:42.634593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:42.635049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:42.635847 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:42.637929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:42.996992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:43.004612 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6311cad9-2ecb-41f9-892d-e9972799b65f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.470794 Dec 08 11:32:43.005387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 107/200] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:42 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:43.010409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:43.011619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:43.017824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:43.018275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:43.019379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:43.019872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:43.153923 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:32:43.162723 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0c26b31e-774e-4915-a0b0-6971226cfba5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.551920 Dec 08 11:32:43.166635 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 94/201] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:32:42 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:32:43.173511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:32:43.176971 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:32:43.186460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:43.187117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:32:43.188074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:32:43.188836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.455826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4235c03c-ead3-4ec2-9d76-fd4be3c7527d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 26.287566 Dec 08 11:33:09.458542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 95/202] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:32:43 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 26291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:09.466937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:09.467779 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:09.482819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.484993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.487279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.491553 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.509771 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c386dbc9-1fdc-4cc0-b538-26f6b9a5990a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 26.502824 Dec 08 11:33:09.514566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 108/203] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:32:43 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 26508 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:09.520835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-823d2060-ed5d-4b51-9057-13d1877395d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:09.525373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:09.525373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:33:09.533967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-823d2060-ed5d-4b51-9057-13d1877395d9 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.534502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-823d2060-ed5d-4b51-9057-13d1877395d9 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.546611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-823d2060-ed5d-4b51-9057-13d1877395d9 service nova] Creating event network-changed:1d5f08a0-9b25-48d8-a2ed-88647aec1670 for instance 96e47acb-aeed-4636-9a70-a1b987abaed6 on hv-cinder-81977 Dec 08 11:33:09.551731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-823d2060-ed5d-4b51-9057-13d1877395d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035504 Dec 08 11:33:09.552618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 109/204] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:09.557614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:09.558598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:09.565900 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.566360 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.567693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.568291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.586206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:09.601631 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1226 microversion: 2.1 time: 0.141567 Dec 08 11:33:09.602215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 96/205] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:09 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:09.606423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:09.607015 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:09.617602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.618104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:09.619005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:09.619503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.091451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:10.093759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:10.110666 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-33606e25-c2d8-446c-aaed-d209d743cfe4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.556581 Dec 08 11:33:10.123235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.519945 Dec 08 11:33:10.123734 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 110/206] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:09 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:10.126267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 97/207] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:09 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:10.131035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:10.131985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:10.138944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.139409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.140203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.140653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.469429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:10.471557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:10.478350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.479243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.480199 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.481020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.827464 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-98ed95cf-9034-47cd-9953-b51f24bbca5f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.361959 Dec 08 11:33:10.828534 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 98/208] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:10 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:10.836321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:10.838332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:10.845756 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.847306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.848710 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.849535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.919863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-31143054-d346-4dd2-b206-2ed90c0931f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.089271 Dec 08 11:33:10.924034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 99/209] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:10 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:10.926648 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:10.927356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:10.934549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.935173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.936119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:10.936605 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.936605 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:10.948309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.822838 Dec 08 11:33:10.952208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 111/210] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:10 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:10.966169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:10.967775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:10.967775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:33:10.980072 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:10.984261 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.003056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f service nova] Creating event network-changed:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:33:11.009760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056859 Dec 08 11:33:11.011358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 112/211] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:11.096213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:11.108746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8158f05b-c64b-45de-9aae-8238dd9f86e3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1280 microversion: 2.1 time: 0.185646 Dec 08 11:33:11.116364 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 100/212] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:10 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:11.129539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:11.130367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:11.139707 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.140960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.142088 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.142765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.143320 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:11.144453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:11.156301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.156972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.158012 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.158654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.813843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:11.822119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-51a1f078-84e4-4fd6-a463-1f086b87dbcf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.683015 Dec 08 11:33:11.823005 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:11.830133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-40a07af4-4f16-4c59-aac1-b326ad0c97cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.706009 Dec 08 11:33:11.830902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 113/213] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:11 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:11.833559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 101/214] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:11 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:11.836214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:11.838286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:11.838286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:33:11.840333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:11.842013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:11.845079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-07160530-5950-45ee-8de7-f7b598d050a3 req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.845745 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-07160530-5950-45ee-8de7-f7b598d050a3 req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.849953 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.850606 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.852052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.852304 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.859254 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-07160530-5950-45ee-8de7-f7b598d050a3 req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d service nova] Creating event network-changed:96b6dc81-7654-48f5-ac3f-e3e4d35982b3 for instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d on hv-cinder-81977 Dec 08 11:33:11.871333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-07160530-5950-45ee-8de7-f7b598d050a3 req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038999 Dec 08 11:33:11.873510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 114/215] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:11.933187 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:11.934325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:11.940990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.942204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:11.942940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:11.943450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:12.550586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4d687197-61aa-4b5b-8bb0-9af880141e38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.714727 Dec 08 11:33:12.551270 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 102/216] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:11 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:12.556437 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:12.557144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:12.559561 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9552d418-4fc4-4af1-bd0f-35743ab686dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.631134 Dec 08 11:33:12.560721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 115/217] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:11 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:12.566124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:12.567117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:12.567908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:12.568550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:12.569263 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:12.570299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:12.577696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:12.578461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:12.579492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:12.580265 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.244587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:13.252210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c373dce0-1ccb-4c47-816f-64f500e122b1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.699709 Dec 08 11:33:13.252790 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 103/218] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:12 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:13.257048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:13.257716 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:13.263429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.263826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.264610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.265052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.282115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:13.290035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-84326d18-054a-4fb5-8297-f19144166140 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.727946 Dec 08 11:33:13.290688 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 116/219] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:12 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:13.303392 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:13.304280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:13.310190 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.310746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.311596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.312124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.640500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:13.648517 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-964e3be5-78ad-4691-9dbc-6103862f769e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.394744 Dec 08 11:33:13.649092 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 104/220] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:13 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:13.653450 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:13.654613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:13.660754 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.661245 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.662041 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.662507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.695873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:13.703642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-951c8265-bbe2-43b3-be10-9b3d81ef273e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.411746 Dec 08 11:33:13.704514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 117/221] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:13 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:13.719083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:13.720369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:13.727667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.728122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.729058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:13.729539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:13.764797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c04f1d0a-faaf-4262-ba87-6d43bb1e5875 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.114435 Dec 08 11:33:13.765467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 105/222] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:13 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:13.807299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0ef5446d-bf88-438d-8334-27945dd7364d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.101141 Dec 08 11:33:13.808398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 118/223] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:13 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:14.025725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-7080c736-32c2-40ac-8f7d-415da68974f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:14.027352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:14.027352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:14.035524 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-7080c736-32c2-40ac-8f7d-415da68974f5 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.035904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-7080c736-32c2-40ac-8f7d-415da68974f5 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.046972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-7080c736-32c2-40ac-8f7d-415da68974f5 service nova] Creating event network-changed:ec0c1efb-b1b3-47b8-91c5-b30707a7222f for instance f4f33a56-55e3-4bc1-a952-b90b6fde964c on hv-cinder-81977 Dec 08 11:33:14.051682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-7080c736-32c2-40ac-8f7d-415da68974f5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030045 Dec 08 11:33:14.052268 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 106/224] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:14.268956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:14.270443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:14.277340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.277801 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.278587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.279053 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.309123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:14.309897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:14.315865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.317001 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.317973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.318410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.573743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:14.576927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:14.581338 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.316572 Dec 08 11:33:14.582425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 119/225] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:14 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:14.592274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cfa19eee-9c1c-4519-affd-e64c380f599c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.288031 Dec 08 11:33:14.593039 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 107/226] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:14 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:14.665934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:14.666551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:14.672778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.673255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.674064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.674501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.721479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:14.722118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:14.727980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.728634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:14.729658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:14.730434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.016428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:15.024796 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5504a059-a03f-4687-8edb-25ae3bc8590b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.362531 Dec 08 11:33:15.034949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 120/227] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:14 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:15.040036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:15.041237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:15.046076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:15.048290 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.048909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.050387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.051501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.054896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.337054 Dec 08 11:33:15.067829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 108/228] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:14 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:15.067829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:15.071838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:15.082617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.083204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.084242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.084639 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.310179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-627458e6-1b23-40fc-89b9-fd351de2d172 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.273656 Dec 08 11:33:15.311047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 121/229] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:15 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:15.323086 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e280de58-91fd-452d-950e-bcddb18df22b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.262356 Dec 08 11:33:15.323651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 109/230] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:15 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:15.599347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:15.600179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:15.610803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:15.611585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:15.618213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.621020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.621593 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.622578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.623089 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.623926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:15.624368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:15.626277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.203887 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:16.217615 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-94c10ed8-5d30-467e-b673-53f189dba75a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.611121 Dec 08 11:33:16.230717 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:16.249645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3ee34ce6-2a0d-4794-bddd-36c495d3248c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.654580 Dec 08 11:33:16.250227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 122/231] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:15 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:16.259940 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 110/232] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:15 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:16.264956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:16.270696 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:16.274062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:16.274909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:16.282857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.283636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.286077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.286732 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.292349 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.293347 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.294657 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.295418 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.598376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:16.606786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-488e15c7-3a4c-4085-b095-fe7644f15111 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.340424 Dec 08 11:33:16.616262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 123/233] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:16 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:16.616433 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:16.617188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-78848891-76a2-44c4-9e3f-0c23839a262d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.355226 Dec 08 11:33:16.621330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 111/234] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:16 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:16.621479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:16.621479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:16.626205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:16.627467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.627807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:16.627974 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.628698 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.629137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.636014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.636461 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:16.637557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:16.638293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.330981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3e5a14b2-a81b-4ce5-95be-c2b545f63ed6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.722006 Dec 08 11:33:17.331624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 124/235] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:16 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:17.336552 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:17.337379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:17.339980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-209c6ff5-98c5-48bf-a907-155fe7f2646c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.720774 Dec 08 11:33:17.340633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 112/236] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:16 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:17.344699 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.345167 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.345613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:17.345966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.346318 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:17.346426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.353320 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.353989 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.354957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.355396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.546488 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:17.555158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-310dc2d2-76f9-4b00-b0c0-163babe85658 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.222201 Dec 08 11:33:17.555983 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 125/237] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:17 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:17.556305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:17.565574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.223557 Dec 08 11:33:17.573933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 113/238] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:17 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:17.623492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:17.624211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:17.632318 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.632792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.633620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.634062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.635612 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:17.636415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:17.642622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.643275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.644501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:17.644947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:17.834450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:17.841402 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:17.848991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.229057 Dec 08 11:33:17.849400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-55def3bf-cea7-440e-90ca-cd36f967d15d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.217356 Dec 08 11:33:17.849721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 126/239] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:17 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:17.850134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 114/240] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:17 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:18.342450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:18.343370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:18.349756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:18.350206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:18.350656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:18.350984 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:18.351416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:18.351561 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:18.357696 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:18.358146 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:18.358920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:18.359351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:20.984321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-69078a88-10f0-4857-9a1e-1d7c8c494061 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 2.636766 Dec 08 11:33:20.985594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 115/241] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:18 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:20.987502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-70a6f18c-fbd2-4233-ae34-c7a73901faf7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 2.648413 Dec 08 11:33:20.988992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 127/242] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:18 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:20.990801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:20.991512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:20.993172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:20.995351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:21.002224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.002513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.002686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.002978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.003486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.004275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.004436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.004711 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.199492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:21.206454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:21.206705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a3f45ed2-0485-45ec-af80-ec819dc866f4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.217448 Dec 08 11:33:21.207269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 128/243] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:20 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:21.211680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:21.212302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:21.213930 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-16288f23-e4fe-44a2-a8ea-83739fb2d67e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.226912 Dec 08 11:33:21.216834 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 116/244] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:20 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:21.218398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.218842 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.219631 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.219920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:21.220083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.220527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:21.226826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.227273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.228062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:21.228501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:21.413668 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:21.421811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:21.422595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8a55553e-f2df-488d-9c06-4ce69da67b66 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.214317 Dec 08 11:33:21.423362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 129/245] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:21 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:21.428691 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.213130 Dec 08 11:33:21.429431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 117/246] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:21 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:21.995831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:21.996886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:21.998514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:21.999495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:22.003135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.004226 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.005009 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.005507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.006296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.006752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.007577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.008020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.182558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6214055e-093f-47b0-bfe5-c9866713c5e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.187569 Dec 08 11:33:22.183202 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 118/247] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:21 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:22.188495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f2b43414-055d-4972-bab5-c06056c7bf73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.196327 Dec 08 11:33:22.189127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 130/248] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:21 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:22.223906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:22.225535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:22.230657 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:22.231348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:22.231485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.231806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.232586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.233021 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.238935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.239379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.240242 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.240682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.434830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:22.438794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:22.443552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4e54aff4-a94f-4366-97ee-6a2d33b7fade tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.223814 Dec 08 11:33:22.444389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 119/249] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:22 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:22.448048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-288af7f0-5a6f-4da3-9403-952cd259fb7e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.221181 Dec 08 11:33:22.448827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 131/250] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:22 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:22.453355 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:22.453958 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:22.457675 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:22.458481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:22.460309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.460763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.461606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.462069 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.466254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.466875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.468207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:22.468721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:22.665630 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:22.669976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:22.674092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.224134 Dec 08 11:33:22.674863 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 132/251] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:22 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:22.677812 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-98d4ca2d-88a9-472a-95db-1fdf06621208 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.232356 Dec 08 11:33:22.678614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 120/252] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:22 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:23.194671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:23.195690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:23.199656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:23.200645 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:23.202161 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.202620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.203416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.203877 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.207319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.207770 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.208570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.209002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.281475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7444da3f-547c-4964-a702-486cc99ff715 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.085054 Dec 08 11:33:23.282023 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 121/253] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:23 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:23.285179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-489fdd26-dc1b-4e65-a3a2-aa2796e32dd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.094526 Dec 08 11:33:23.285945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 133/254] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:23 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:23.460164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:23.460874 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:23.464856 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:23.465581 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:23.468334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.468642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.469487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.469931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.472370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.472802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.473629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.474063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.663903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:23.670929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:23.671378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.215275 Dec 08 11:33:23.671957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 122/255] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:23 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:23.679131 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.218060 Dec 08 11:33:23.679690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 134/256] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:23 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:23.690799 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:23.691408 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:23.693884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:23.694488 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:23.697542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.698162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.698965 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.699407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.700212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.700660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.701471 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:23.701900 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:23.892573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:23.896339 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:23.900508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.210180 Dec 08 11:33:23.901081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 135/257] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:23 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:23.903638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.216406 Dec 08 11:33:23.904355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 123/258] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:23 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:24.293353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:24.294486 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:24.295527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:24.296672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:24.300755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.301233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.302020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.302457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.302960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.303415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.304199 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.304638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.534629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f3a9066b-4b73-40d4-a706-7586206aeaaa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.242568 Dec 08 11:33:24.535281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 124/259] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:24 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:24.538734 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ad257160-daee-4d59-987c-c8fa4d17be06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.249138 Dec 08 11:33:24.539393 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 136/260] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:24 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:24.689170 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:24.689889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:24.696443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:24.697141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:24.697332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.697784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.698748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.699145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.703372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.703822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.704622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.705041 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.895055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:24.898287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:24.902432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-de06dcd7-67e7-412f-a69b-736398b9f92d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.217251 Dec 08 11:33:24.903073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 125/261] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:24 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:24.905552 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-faa0782a-e0ec-452d-84b1-f144e320ee2a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.212960 Dec 08 11:33:24.906179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 137/262] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:24 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:24.917527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:24.918127 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:24.920269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:24.920882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:24.924031 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.924470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.925771 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.926211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.927178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.927636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:24.928415 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:24.928856 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.114694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:25.121663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:25.122173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.208029 Dec 08 11:33:25.122746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 126/263] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:24 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:25.129355 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2997790a-632d-4162-b4cf-03666d3df913 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.212013 Dec 08 11:33:25.129897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 138/264] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:24 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:25.547273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:25.548398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:25.550022 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:25.552729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:25.560558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.560558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.560558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.560558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.563073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.563547 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.564344 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.564782 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.792892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2a43f55e-d9ff-4ca3-ae4b-a4cd9c9a8d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.246446 Dec 08 11:33:25.794202 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 139/265] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:25 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:25.796207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-61281a91-46b2-4c5f-821a-ca704e13eefb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.252498 Dec 08 11:33:25.798081 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 127/266] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:25 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:25.799444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2088454587", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "a19166f1-a36a-4f08-8a61-f4d3fa1e8383"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:25.803977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-1d123ec4-f346-4080-b21d-a8a781ca4b8c req-7051532d-f99a-4371-a5e8-59b81fea2c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "name": "network-vif-plugged", "status": "completed", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:25.805509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:25.805509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:25.813340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-1d123ec4-f346-4080-b21d-a8a781ca4b8c req-7051532d-f99a-4371-a5e8-59b81fea2c75 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.813787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-1d123ec4-f346-4080-b21d-a8a781ca4b8c req-7051532d-f99a-4371-a5e8-59b81fea2c75 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.826474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-1d123ec4-f346-4080-b21d-a8a781ca4b8c req-7051532d-f99a-4371-a5e8-59b81fea2c75 service nova] Creating event network-vif-plugged:6487232e-a2f6-40ee-bcd9-a49395653c34 for instance 3c255cd4-9751-4e4f-883b-9399d6a8c37e on hv-cinder-81977 Dec 08 11:33:25.832368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-1d123ec4-f346-4080-b21d-a8a781ca4b8c req-7051532d-f99a-4371-a5e8-59b81fea2c75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032242 Dec 08 11:33:25.833555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 128/267] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:25.856234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] validate_networks() for [('a19166f1-a36a-4f08-8a61-f4d3fa1e8383', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:33:25.920549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:25.921262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:25.931573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.933387 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:25.935496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:25.936497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.241703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:26.248968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-94b03cb8-0a8a-4301-9e0f-57983de82016 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.333473 Dec 08 11:33:26.249610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 129/268] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:25 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:26.254729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:26.255324 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:26.261236 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.261690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.262504 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.262940 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.385456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:33:26.385989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:33:26.386466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:33:26.386876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:33:26.387284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:33:26.396872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.397371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.398194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.398632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.415409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Getting quotas for project b1b41ae149164acbb31b021c9049b500. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:33:26.419273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Getting quotas for user 97f278a968674782b818bb4e83572402 and project b1b41ae149164acbb31b021c9049b500. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:33:26.430346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:26.430504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:33:26.432857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:33:26.437629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-318a5b31-b0af-44a2-9d74-ab727411f782 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.186974 Dec 08 11:33:26.438190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 130/269] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:26 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:26.442948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:26.443468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:26.449320 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.449776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.450570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.451011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.478762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683212 Dec 08 11:33:26.479561 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 140/270] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:33:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:33:26.483582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:26.484182 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:26.490933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.491384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.492567 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.493233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.622656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:26.631432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-147a5284-69ae-49aa-99ce-9acbc256d46f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.192189 Dec 08 11:33:26.632183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 131/271] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:26 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:26.636746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1a4d61c7-f5c5-4468-93be-24c385766c6e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:26.637371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1a4d61c7-f5c5-4468-93be-24c385766c6e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:26.673291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:26.682972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-24336664-8bab-4aae-a816-4ed6963bfe68 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.202522 Dec 08 11:33:26.683558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 141/272] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:26 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:26.702187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1a4d61c7-f5c5-4468-93be-24c385766c6e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:26.711190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1a4d61c7-f5c5-4468-93be-24c385766c6e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1219 microversion: 2.1 time: 0.077072 Dec 08 11:33:26.713195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 132/273] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:26 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:26.804832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:26.805815 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:26.807510 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:26.808480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:26.812654 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.813340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.814174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.814308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.814685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.815225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.815471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:26.815946 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:26.894226 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9a4eb17a-9259-4089-a960-9a40848ea399 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.089708 Dec 08 11:33:26.895113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 133/274] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:26 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:26.898715 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8204a856-c9bc-4115-a736-355b4dda1df9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.098366 Dec 08 11:33:26.899433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 142/275] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:26 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:27.266672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:27.267283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:27.274820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.275271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.276050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.276488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.408055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:27.416821 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-243b182d-56f8-4676-86b2-abc2a8591d54 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1313 microversion: 2.1 time: 0.154071 Dec 08 11:33:27.417470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 134/276] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:27 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:27.456349 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:27.457636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:27.464091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.464537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.465346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.465844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.649004 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:27.649659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:27.657245 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.658047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.659107 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.659806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.704431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:27.720430 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-442dc498-a25f-43c8-a935-a574fa84565c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.269146 Dec 08 11:33:27.730773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 143/277] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:27 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:27.736904 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:27.737789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:27.746115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.746864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.747940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.748572 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.948929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:27.961463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a12db327-b4a7-4777-ac45-c206282063ed tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.315991 Dec 08 11:33:27.962508 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 135/278] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:27 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:27.984007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:27.984730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:27.992866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.993368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:27.994171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:27.994621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.061339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:28.070598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5d85618a-e31d-46f7-a3c4-4467312652b8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.338128 Dec 08 11:33:28.071586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 144/279] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:27 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:28.076299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-b8638c46-243a-4179-8393-a19989b00064 req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "name": "network-vif-plugged", "status": "completed", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:28.087810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:28.113759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:28.113759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:33:28.122714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-922ade55-9eca-46f5-a083-e92ef38da773 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1277 microversion: 2.1 time: 0.144235 Dec 08 11:33:28.131045 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 136/280] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:27 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:28.149252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-b8638c46-243a-4179-8393-a19989b00064 req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.149712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-b8638c46-243a-4179-8393-a19989b00064 req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.151225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:28.156530 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:28.182833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.183424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.184461 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.185061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.200796 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-b8638c46-243a-4179-8393-a19989b00064 req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 service nova] Creating event network-vif-plugged:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:33:28.213814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-b8638c46-243a-4179-8393-a19989b00064 req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140877 Dec 08 11:33:28.214946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 145/281] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:28.228660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:28.229718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:28.241228 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.241962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.243275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.245589 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.302825 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5765396b-e169-4df0-a244-724cb7ef83cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.169651 Dec 08 11:33:28.308600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 137/282] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:28 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:28.430121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-549f989c-e0b6-49c8-957c-0012caab46f0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.213325 Dec 08 11:33:28.431862 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 146/283] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:28 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:28.434384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:28.435098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:28.446445 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.446913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.447759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.448212 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.737943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:28.738653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:28.742026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:28.745832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.746285 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.747089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.747524 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:28.750225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3f259267-aa46-4d4d-9411-31054df9ad43 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1497 microversion: 2.1 time: 0.319791 Dec 08 11:33:28.751071 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 138/284] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:28 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:28.979947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:28.980781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:28.998801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:28.999432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.000409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.000849 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.018399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:29.027678 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dc79d48f-8b83-464d-b2c5-933f6746f499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.293734 Dec 08 11:33:29.028981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 147/285] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:28 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:29.086977 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:29.088266 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:29.094676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.095124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.095909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.096342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.470278 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:29.478196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2efd0b47-35dd-41d3-af93-b70e9af17cac tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.503092 Dec 08 11:33:29.478854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 139/286] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:28 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:29.484484 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:29.485392 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:29.502751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.504085 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.505109 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.505928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.666280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:29.673822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.590745 Dec 08 11:33:29.674308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 148/287] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:29 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:29.679230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:29.679728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:29.688387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.689115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.689682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.690121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.714639 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:33:29.770446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:29.778501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-232b5622-01ed-47bc-b550-1536d049a2ef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.298462 Dec 08 11:33:29.779248 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 140/288] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:29 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:29.784181 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:29.785817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:29.792114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.792688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.793817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.794683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 204 len: 0 microversion: 2.1 time: 0.119143 Dec 08 11:33:29.795192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.797380 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 149/289] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:33:29 2021] DELETE /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:33:29.805686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:29.807127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:29.814662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.815325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.816197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.816633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.884477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-babca35e-05f4-4d4c-9667-7c0fd5c164a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.103686 Dec 08 11:33:29.888440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 141/290] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:29 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:29.889941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:29.890641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:29.897853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.898313 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.899097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.899540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.900760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1c304d67-3d93-4535-9d70-b48b0b41234b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.100825 Dec 08 11:33:29.902069 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 150/291] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:29 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:29.923160 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-8e709b87-1176-4088-969e-11883df92f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:29.929445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:29.929445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:33:29.954802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-8e709b87-1176-4088-969e-11883df92f49 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:29.955313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-8e709b87-1176-4088-969e-11883df92f49 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:29.969592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-8e709b87-1176-4088-969e-11883df92f49 service nova] Creating event network-changed:111e4836-2539-424a-86c3-da84a2a2dc76 for instance 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 on hv-cinder-81977 Dec 08 11:33:29.975039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-8e709b87-1176-4088-969e-11883df92f49 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063106 Dec 08 11:33:29.975638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 151/292] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:33:30.045834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:30.046537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:30.052480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.052933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.053746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.054186 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.075175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:30.083050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-79453e7f-dce3-4b1a-b516-487c81c63e27 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1503 microversion: 2.1 time: 0.196733 Dec 08 11:33:30.083604 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 142/293] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:29 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:30.184193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:30.191461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.150123 Dec 08 11:33:30.192012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 152/294] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:30 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:30.311811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "name": "network-vif-plugged", "status": "completed", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670"}, {"server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "name": "network-vif-plugged", "status": "completed", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3"}, {"server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "name": "network-vif-plugged", "status": "completed", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:30.313614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:30.313614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:30.321934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.322377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.335869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] Creating event network-vif-plugged:1d5f08a0-9b25-48d8-a2ed-88647aec1670 for instance 96e47acb-aeed-4636-9a70-a1b987abaed6 on hv-cinder-81977 Dec 08 11:33:30.336374 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] Creating event network-vif-plugged:96b6dc81-7654-48f5-ac3f-e3e4d35982b3 for instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d on hv-cinder-81977 Dec 08 11:33:30.336874 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] Creating event network-vif-plugged:ec0c1efb-b1b3-47b8-91c5-b30707a7222f for instance f4f33a56-55e3-4bc1-a952-b90b6fde964c on hv-cinder-81977 Dec 08 11:33:30.344382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f req-e32f903d-ddfa-4233-a14d-01bf24722856 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036291 Dec 08 11:33:30.344938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 143/295] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:30 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:30.494995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:30.495607 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:30.501791 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.502242 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.503017 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.504003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.669509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:30.677787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.186553 Dec 08 11:33:30.678714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 153/296] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:30 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:30.692966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:30.693700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:30.705247 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.705706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.707100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.707542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.796129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:30.796827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:30.803872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.804326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.805113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.805573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.886345 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:30.894013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a4769bd0-6ed1-4669-adb9-59e456bc56dc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1357 microversion: 2.1 time: 0.206157 Dec 08 11:33:30.894591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 144/297] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:30 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:30.905802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:30.906856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:30.913223 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.913681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.914476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.914915 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.951361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:30.958751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b1b8ce84-8c87-47f6-974d-a626f04ba531 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.166375 Dec 08 11:33:30.959311 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 154/298] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:30 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:30.963570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:30.964518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:30.969961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.970412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:30.971193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:30.971635 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.354244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5a0fd82a-9195-4d90-bf17-f0d7d51b8a9d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 3.451810 Dec 08 11:33:34.354903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 145/299] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:30 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 3460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:34.359706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:34.360419 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:34.368033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.368491 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.369334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.369781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.376673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1b976734-443f-43c1-b76e-8754244539f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 3.414073 Dec 08 11:33:34.379488 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 155/300] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:30 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 3419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:34.384566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:34.387273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:34.400853 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.406198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.407499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.408319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.672907 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:34.680130 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:34.681319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1fb0e29e-865e-406b-a527-903ba711fd38 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1503 microversion: 2.1 time: 0.325242 Dec 08 11:33:34.681908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 146/301] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:34 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:34.686908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:34.688046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:34.690023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-950ff726-f199-470f-a284-36affd506d1a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.309272 Dec 08 11:33:34.690742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 156/302] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:34 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:34.696460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.696942 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.697763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.698201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.705954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:34.707070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:34.713210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.713210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.713992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.714429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.889335 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:34.897032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:34.897386 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-51c4889e-5150-40a7-bce9-09e1a0fe166a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.214494 Dec 08 11:33:34.897944 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 147/303] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:34 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:34.902097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:34.902700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:34.904624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1547 microversion: 2.1 time: 0.213094 Dec 08 11:33:34.905335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 157/304] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:34 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1547 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:34.908329 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.908774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.910206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.910638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.921433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:34.922037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:34.927616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.928058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:34.928824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:34.929286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:35.236142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:35.244255 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1d5b69ba-6310-4263-afba-b4d8f56798ce tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.345340 Dec 08 11:33:35.244897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 148/305] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:34 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:35.255528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:35.264062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dd35e4b3-f458-478e-a68b-020f221f88e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1547 microversion: 2.1 time: 0.345683 Dec 08 11:33:35.265062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 158/306] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:34 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1547 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:35.280981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:35.285034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:35.285034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:35.286055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:35.286791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Searching by: {'deleted': False, 'project_id': '3102b9c0f7ea45048750ae3c81085631'} {{(pid=117269) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 08 11:33:35.293287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:35.293731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:35.294536 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:35.294966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:35.365639 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:35.366601 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:35.372181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:35.372626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:35.373417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:35.373849 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:35.381694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.multi_cell_list [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 08 11:33:35.478760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aeca7803-f1cd-496c-808e-6e4a93de36f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201425 Dec 08 11:33:35.479348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 149/307] 10.222.0.66 () {58 vars in 1124 bytes} [Wed Dec 8 11:33:35 2021] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:33:35.484698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:35.485599 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:35.491388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:35.491841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:35.492621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:35.493061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.043418 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6f7a8a61-28f5-4a90-8ff2-2b87f42f7c8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.681210 Dec 08 11:33:36.044529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 159/308] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:35 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:36.048686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:36.049397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:36.056514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.056961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.057767 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.058200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.072201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e2b28798-ae11-4de2-93f3-0fb6a803c375 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.590616 Dec 08 11:33:36.073165 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 150/309] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:35 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:36.080892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:36.082383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:36.092869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.093352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.094146 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.094583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.360423 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:36.370452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:36.377636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1547 microversion: 2.1 time: 0.332456 Dec 08 11:33:36.379091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 160/310] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:36 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1547 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:36.383094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:36.383697 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:36.387523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1503 microversion: 2.1 time: 0.311954 Dec 08 11:33:36.388102 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 151/311] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:36 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:36.391264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.391930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.392932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.393054 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:36.393913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:36.394223 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.399745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.400412 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.401588 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.401952 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.710524 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:36.715220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:36.718329 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1318 microversion: 2.1 time: 0.329225 Dec 08 11:33:36.719365 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 152/312] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:36 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:36.724691 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:36.725569 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:36.731642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.732414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.733469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:36.734075 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0ce9e001-8f25-4ec3-889a-9b59a057a927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.353934 Dec 08 11:33:36.734242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:36.745334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 161/313] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:36 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:36.921031 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:36.928192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.207738 Dec 08 11:33:36.928753 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 153/314] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:36 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:37.055136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:37.056162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:37.061986 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.062522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.063222 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.063656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.084805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:37.085800 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:37.092204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.092568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.093511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.093945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.250305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1a7070c7-362a-4393-9d93-7e3ad5a5dd23 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.198947 Dec 08 11:33:37.250857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 162/315] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:37 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:37.254833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b35de8f7-de6d-4628-b4c6-0bf620d5ce30 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.174414 Dec 08 11:33:37.255463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 154/316] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:37 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:37.405354 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:37.406069 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:37.412841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.413331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.414098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.414526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.549468 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:37.557332 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1503 microversion: 2.1 time: 0.155883 Dec 08 11:33:37.557887 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 163/317] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:37 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:37.736355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:37.737763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:37.745112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.745595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.746480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.748897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.755013 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:37.755642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:37.761886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.762344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:37.763399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:37.776558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.095363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:38.102582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:38.113356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4e5f11d8-b501-4512-a656-527e1fbefad4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1506 microversion: 2.1 time: 0.380423 Dec 08 11:33:38.114751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6258cf3d-f465-4e2d-a190-8f02362c6759 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1322 microversion: 2.1 time: 0.366690 Dec 08 11:33:38.126526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 155/318] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:37 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:38.126526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:38.126526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.127677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 164/319] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:37 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:38.127677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2873984-c057-4042-b9ac-c762a051ee04"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:38.128239 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.135211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.135664 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.135864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.136124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.136460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.136897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.137006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.137442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.473676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c3c45c1f-30a3-4eaf-aff9-c181cdd443c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351373 Dec 08 11:33:38.474289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 165/320] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:33:38 2021] POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:38.479993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f347733-a06b-46b3-b30b-9114ff2a0bf6"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:38.481496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.490748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.491372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.492411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.492923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.589193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] HTTP exception thrown: Invalid volume: volume 5f347733-a06b-46b3-b30b-9114ff2a0bf6 is already attached to instances: c7fa09fb-ae2b-4479-8848-f142131fe33a Dec 08 11:33:38.590673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Returning 400 to user: Invalid volume: volume 5f347733-a06b-46b3-b30b-9114ff2a0bf6 is already attached to instances: c7fa09fb-ae2b-4479-8848-f142131fe33a {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:33:38.591604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c7aae98a-fe04-411a-9b0f-be82de762c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116191 Dec 08 11:33:38.592559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 166/321] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:33:38 2021] POST /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 08 11:33:38.600487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:38.602949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.614674 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.615371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.616332 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.616947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.630167 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:38.644499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-dd4c4586-17ef-4144-baf8-d63982b6ab1a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.526931 Dec 08 11:33:38.668105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 156/322] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:38 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:38.672688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:38.673628 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.684100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.684586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.685601 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.686360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.721162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bb59c405-49fe-4cf9-b7d2-833182996ccf tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.127132 Dec 08 11:33:38.722197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 167/323] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:38 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:38.729286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:38.730307 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.738057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.738519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.739349 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.739789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.771652 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.772104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.772558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lazy-loading 'fault' on Instance uuid 3c255cd4-9751-4e4f-883b-9399d6a8c37e {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:33:38.782325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6c626cdc-d887-476d-af12-898e4a714c06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.112943 Dec 08 11:33:38.783105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 157/324] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:38 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:38.788052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-e6e3aac5-8f01-448b-a832-c6071184cd71 req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "name": "network-vif-deleted", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:38.789766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:38.789766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:38.797741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e6e3aac5-8f01-448b-a832-c6071184cd71 req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.798272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e6e3aac5-8f01-448b-a832-c6071184cd71 req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.809857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-e6e3aac5-8f01-448b-a832-c6071184cd71 req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 service nova] Creating event network-vif-deleted:6487232e-a2f6-40ee-bcd9-a49395653c34 for instance 3c255cd4-9751-4e4f-883b-9399d6a8c37e on hv-cinder-81977 Dec 08 11:33:38.812164 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e4404546cc4229b8b0a2cff9bb76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:38.814658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-e6e3aac5-8f01-448b-a832-c6071184cd71 req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030223 Dec 08 11:33:38.815774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 158/325] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:38.820157 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7c52429e-f325-4908-ab8f-dbf000cd9345 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 200 len: 1303 microversion: 2.1 time: 0.095610 Dec 08 11:33:38.820704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 168/326] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:38 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:38.820817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:38.821421 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:38.827372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.827828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.828610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:38.829052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:38.949314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'services' on Instance uuid c7fa09fb-ae2b-4479-8848-f142131fe33a {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:33:39.062873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-88018b2f-81f1-4827-8460-eea9e3dff5a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments/5f347733-a06b-46b3-b30b-9114ff2a0bf6" status: 202 len: 0 microversion: 2.1 time: 0.245189 Dec 08 11:33:39.063567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 159/327] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:33:38 2021] DELETE /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments/5f347733-a06b-46b3-b30b-9114ff2a0bf6 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:39.072609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:39.073857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.083559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.083559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.083559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.083559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.112903 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-71eb18ed-3558-49c4-abb1-99d47a4493bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Dec 08 11:33:39.113525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 169/328] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:39 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:33:39.138322 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:39.139039 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.146698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.147157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.147991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.148431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.284704 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:39.292098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-40c321ad-0bce-4493-aca6-de3fbfe03411 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1517 microversion: 2.1 time: 0.158779 Dec 08 11:33:39.292658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 160/329] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:39 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:39.309239 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:39.310204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.316957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.317433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.318208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.318636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.340718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lazy-loading 'flavor' on Instance uuid f4f33a56-55e3-4bc1-a952-b90b6fde964c {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:33:39.446857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5ee2ea17-4079-4075-9452-0413ec330ef2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c/action" status: 200 len: 32 microversion: 2.1 time: 0.141237 Dec 08 11:33:39.447647 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 170/330] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:39 2021] POST /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:33:39.456941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:39.457595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.464013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.464728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.465293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.465759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.663213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:39.663917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.670906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.671356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.672153 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.672592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.690148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:39.703389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d9150f6f-b182-4a93-b65a-2976295ed25b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.250463 Dec 08 11:33:39.704787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 161/331] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:39 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:39.734502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:39.735770 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.743574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.744167 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.744964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.745422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.808894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6ece0613-1f38-4b71-9bab-5b94e3f7a461 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.079869 Dec 08 11:33:39.813464 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 162/332] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:39 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:39.814827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:39.818173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.823831 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.824398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.825328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.825889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.902105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4f00e747-cb43-42b5-9227-b194e759022e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.090911 Dec 08 11:33:39.906467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 163/333] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:39 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:39.907578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:39.908299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] [instance: 3c255cd4-9751-4e4f-883b-9399d6a8c37e] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:39.915163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.915619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.916398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:39.916834 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:39.917906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:39.925867 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6495465b-ab30-4b98-8599-edd9fb712118 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.266794 Dec 08 11:33:39.935362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 171/334] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:39 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:39.935523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] HTTP exception thrown: Instance 3c255cd4-9751-4e4f-883b-9399d6a8c37e could not be found. Dec 08 11:33:39.935523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Returning 404 to user: Instance 3c255cd4-9751-4e4f-883b-9399d6a8c37e could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:33:39.935523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-44b8a5c5-0d4f-4bfd-8e53-8d20772a41bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e" status: 404 len: 111 microversion: 2.1 time: 0.031361 Dec 08 11:33:39.935795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 164/335] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:39 2021] GET /compute/v2.1/servers/3c255cd4-9751-4e4f-883b-9399d6a8c37e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:33:40.123831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:40.125278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:40.132166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.132681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.133506 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.133988 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.169141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9334d87f-9839-4ef5-94a7-b9e0f261a1a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049121 Dec 08 11:33:40.169726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 172/336] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:40 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:40.721621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:40.722759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:40.728948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.729446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.730276 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.730719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.819972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:40.820884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:40.827012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.827637 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.828607 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.829051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.871749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:40.879346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.161390 Dec 08 11:33:40.879995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 165/337] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:40 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:40.913562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:40.914563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:40.920328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.920845 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:40.921720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:40.922219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:41.468333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b2f7c0a2-0f1b-4a54-a0d7-9e5eaeb07365 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.651722 Dec 08 11:33:41.469374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 173/338] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:40 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:41.475044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:41.475904 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:41.477694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-557f0c68-0e0c-4e73-8cdf-b80260229cf0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.568082 Dec 08 11:33:41.478489 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 166/339] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:40 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:41.484098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:41.485089 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:41.486485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:41.486876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:41.487709 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:41.488539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:41.493716 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:41.494189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:41.494986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:41.495421 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:41.535933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-45e541f6-316b-4fa6-b695-e17f6c06411a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056040 Dec 08 11:33:41.536609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 167/340] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:41 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:41.626208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:41.633432 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-432bf489-941c-49d8-ad3e-c57f41664709 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.162742 Dec 08 11:33:41.633993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 174/341] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:41 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:41.896868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:41.899084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:41.905448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:41.905993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:41.906859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:41.907306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:42.129563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:42.137578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c9bb75c3-2969-45ae-b000-3a26d24667c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.245114 Dec 08 11:33:42.138152 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 168/342] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:41 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:42.479906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:42.481060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:42.489467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:42.490233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:42.491293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:42.492122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:42.492533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:42.493001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:42.499707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:42.500369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:42.501380 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:42.501974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.732327 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-335081e2-ee0b-4099-b350-8c2fe9aa08ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 3.255982 Dec 08 11:33:45.734013 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 175/343] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:42 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 3258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:45.739452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:45.740878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:45.743426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8329ec1c-5d21-428d-9586-5f766651c55c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 3.256347 Dec 08 11:33:45.747370 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 169/344] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:42 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 3258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:45.749700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:45.755424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:45.755945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.756426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:45.756893 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:45.757446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.764560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:45.765259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.766440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:45.767072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.793278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8605b3cb-6142-447f-b1d9-f95d75fa7d27 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057841 Dec 08 11:33:45.793936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 176/345] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:45 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:45.802218 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:45.802846 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:45.808631 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:45.809327 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.810281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:45.810874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:45.984647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:45.993218 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.247302 Dec 08 11:33:45.994406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 170/346] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:45 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:46.017905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:46.029288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.230994 Dec 08 11:33:46.030027 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 177/347] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:45 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:46.744027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:46.744973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:46.755193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:46.760535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:46.760535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:46.761280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:46.761699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:46.782954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:46.796857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:46.801779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:46.804913 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:46.807386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:46.875845 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b7cbca4b-c4d7-44b5-89a5-07ce8d43e45c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.134759 Dec 08 11:33:46.877892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 171/348] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:46 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:46.886077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:46.887114 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ec06b9d4-8775-4b0b-9f52-f81a014d0c2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.134671 Dec 08 11:33:46.887981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:46.888104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 178/349] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:46 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:46.897313 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:46.898701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:46.900057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:46.901032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:46.942125 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bd8f7e85-5b73-4e04-a550-9cba591892d7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062554 Dec 08 11:33:46.943135 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 172/350] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:46 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:47.020902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:47.022051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:47.033924 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.034670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.035660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.036287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.046469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:47.047078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:47.057204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.058025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.059190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.059870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.280656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:47.287990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e3737c10-4110-4102-9505-a0fbadd8eb98 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.272066 Dec 08 11:33:47.288751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 179/351] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:47 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:47.356859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:47.369246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-487f1a8d-934d-4b9c-b324-22c55ce9036a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.326200 Dec 08 11:33:47.370086 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 173/352] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:47 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:47.887817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:47.889409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:47.898297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.899157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:47.900167 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:47.900329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.901898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.902539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.911269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.912002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.913025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:47.913715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:47.999845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f7fd2483-e7e3-4953-b99f-90677a4e3a00 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.115373 Dec 08 11:33:48.001204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 180/353] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:47 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:33:48.009102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:48.010386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:48.012381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-96388c9c-dcb4-408a-8852-e639798a87ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.116805 Dec 08 11:33:48.014007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 174/354] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:47 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:48.022008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.024215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.025111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.025779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.104772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8953004f-5d3b-4f77-a084-c359804ffd8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102110 Dec 08 11:33:48.105955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 181/355] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:48 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:48.306122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:48.307073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:48.320346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.321027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.322098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.327314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.386740 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:48.387359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:48.396965 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.397756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.410319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.411104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.566815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:48.580756 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ee2ed485-e708-4574-9118-5acfe3961aee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.276042 Dec 08 11:33:48.581774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 175/356] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:48 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:48.661911 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:48.673846 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-18ee4cba-3b5f-4787-8712-647611d967ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.290690 Dec 08 11:33:48.690556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 182/357] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:48 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:48.729665 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-bf6e6447-ebe2-49ce-be96-f64879f244c3 req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "name": "network-vif-plugged", "status": "completed", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:48.731620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:48.731620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:48.744404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-bf6e6447-ebe2-49ce-be96-f64879f244c3 req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:48.744859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-bf6e6447-ebe2-49ce-be96-f64879f244c3 req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:48.774620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-bf6e6447-ebe2-49ce-be96-f64879f244c3 req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 service nova] Creating event network-vif-plugged:111e4836-2539-424a-86c3-da84a2a2dc76 for instance 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 on hv-cinder-81977 Dec 08 11:33:48.790429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-bf6e6447-ebe2-49ce-be96-f64879f244c3 req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064197 Dec 08 11:33:48.791611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 176/358] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:33:49.014780 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:49.016372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:49.028678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:49.032853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:49.051568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.051995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.052806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.053307 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.055909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.056556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.067574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.068252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.224607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7781703a-ffb1-4fdd-afea-cd6c1f6a94dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.203012 Dec 08 11:33:49.231543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 177/359] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:49 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:33:49.245496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:49.246769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:49.258964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4794a3a9-0176-4ae9-ac18-bea94ec9cbf1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.247414 Dec 08 11:33:49.258964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 183/360] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:49 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:49.277648 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.278329 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.279317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.281607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.380145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ecd53225-0652-464b-8192-6c3b3f1ad15b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146715 Dec 08 11:33:49.380734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 178/361] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:49 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:49.602045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:49.603548 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:49.623637 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.624389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.630916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.631453 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.701504 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:49.702123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:49.712305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.712763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:49.713596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:49.714034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.215265 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:50.234746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0802e62b-e700-4041-bb66-4021a18cdc43 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.636932 Dec 08 11:33:50.236184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 184/362] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:49 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:50.260370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:50.266540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:50.289402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:50.290093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.293395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:50.294039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.308619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:50.319165 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-334362ea-910c-427c-86bc-746381cb4f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.621554 Dec 08 11:33:50.325940 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 179/363] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:49 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:50.336005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:50.351435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:50.367486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:50.377174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.382292 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:50.383026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.437973 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-13287052-6b5f-4d55-8533-c4b98053217e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.196427 Dec 08 11:33:50.438864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 185/364] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:50 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:50.479578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:50.481169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:50.499538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:50.500262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.501838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:50.503020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:50.555367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-196b7d55-11ef-43b5-a24a-6abfb47105bf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103884 Dec 08 11:33:50.556528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 186/365] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:50 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:50.561506 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-052d4f00-6c8c-4d6b-9432-a1e1774f5b20 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.233958 Dec 08 11:33:50.566046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 180/366] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:50 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:51.268932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:51.268932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:51.279839 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:51.283523 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:51.289539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:51.290431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:51.342272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:51.343323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:51.385858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:51.391157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:51.402977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:51.404648 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:51.938141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:51.957188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a4c2c871-6a89-4252-999b-fca8deda978d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.619156 Dec 08 11:33:51.957690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 181/367] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:51 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:51.987378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:51.990453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:52.016970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.024072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.024944 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.025532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.029273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:52.039472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-204f36ce-e2cc-45d8-898e-2777e16b3eaa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1319 microversion: 2.1 time: 0.790746 Dec 08 11:33:52.050604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 187/368] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:51 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1319 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:52.056360 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:52.061467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:52.100855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.112106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.114143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.115760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.142207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cd0efd99-b6ab-41dc-8315-88efee2fe60e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.182782 Dec 08 11:33:52.143879 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 182/369] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:51 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:52.152548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:52.157260 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:52.176346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.177706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.180373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.182468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.239085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f9d9e91d-3a2a-48ba-aff5-4393de0439ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187071 Dec 08 11:33:52.240442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 188/370] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:52 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:52.320786 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0f8a06f1-6a85-4d7d-b821-397feee3f804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.175423 Dec 08 11:33:52.321831 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 183/371] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:52 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:52.912985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:52.914370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:52.921832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.924534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.925802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.926438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.975328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:52.976616 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:52.990809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.991553 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:52.992539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:52.994047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.370964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:53.379487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-72376cca-fa78-43db-b8aa-0ab76dfb5efe tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1593 microversion: 2.1 time: 0.470182 Dec 08 11:33:53.380293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 189/372] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:52 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1593 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:53.385603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:53.386956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:53.397214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.399152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.400150 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.401542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.466580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:53.477438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-150bded8-e787-47ec-b26d-bfc86ce3d4ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.507160 Dec 08 11:33:53.486432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 184/373] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:52 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:53.504118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:53.506261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:53.516226 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.516993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.523219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.524382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.673166 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8888a487-2953-49f5-9ec2-02139f9c989d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.185206 Dec 08 11:33:53.673824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 185/374] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:53 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:53.697274 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:53.710007 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1508 microversion: 2.1 time: 0.328321 Dec 08 11:33:53.712013 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 190/375] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:53 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:53.718370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:53.719663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:53.727503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.728199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.732936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.733662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.807370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5cc32c24-5663-4af1-90c2-6df2ae407768 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094048 Dec 08 11:33:53.824040 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 191/376] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:33:53 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:33:53.845387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:53.849452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:53.862001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.866948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.871932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:53.872948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:53.979599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ad9da2bb-434e-4a09-98a9-0531e2ef5bfc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.153946 Dec 08 11:33:53.980235 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 192/377] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:53 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:54.045509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c2812b08-9f97-4265-bb37-977f3f7f7493 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Action: 'create', calling method: .version_select at 0x7f1fa6fff0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1810756953"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:54.099366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-c2812b08-9f97-4265-bb37-977f3f7f7493 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Getting quotas for project 23027f58b51142389f64405702a0fcd3. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:33:54.119787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-c2812b08-9f97-4265-bb37-977f3f7f7493 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Getting quotas for user abe3782a7d2e48cc922a46faf9c476d3 and project 23027f58b51142389f64405702a0fcd3. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:33:54.120583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-209429312", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "6e4bda07-1ae1-4be4-bf28-e94211f51919"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:54.261532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] validate_networks() for [('6e4bda07-1ae1-4be4-bf28-e94211f51919', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:33:54.412251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-c2812b08-9f97-4265-bb37-977f3f7f7493 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Getting quotas for project 23027f58b51142389f64405702a0fcd3. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:33:54.441135 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-c2812b08-9f97-4265-bb37-977f3f7f7493 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Getting quotas for user abe3782a7d2e48cc922a46faf9c476d3 and project 23027f58b51142389f64405702a0fcd3. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:33:54.491867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c2812b08-9f97-4265-bb37-977f3f7f7493 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.816757 Dec 08 11:33:54.492471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 186/378] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Dec 8 11:33:53 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:54.507061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:54.512633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:54.541675 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:54.542468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:54.544515 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:54.545210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.587608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:55.596511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0d711da9-071e-4cbf-b07c-267e36f74096 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 1.096557 Dec 08 11:33:55.605544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 187/379] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:54 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:55.610390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:55.612112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:55.643011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:55.643736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.644752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:55.646181 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.749176 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-50d3ca67-3b64-4d54-84de-0249180e5238 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.142247 Dec 08 11:33:55.750536 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 188/380] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:55 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:55.758366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:55.764074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:55.772674 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:55.773326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.774327 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:55.774927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.831502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:33:55.832003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:33:55.832724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:33:55.833198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:33:55.833795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:33:55.867982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:55.868752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.869850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:55.870591 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:55.875663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6695a18c-8802-4988-97ad-b51438e72212 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.123492 Dec 08 11:33:55.877013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 189/381] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:55 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:55.907918 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:33:55.914372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for user 3d93916bc3fd40fb8f60f9b7a592a29f and project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:33:55.929889 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:33:55.933062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:33:56.015397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899604 Dec 08 11:33:56.016985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 193/382] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:33:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:33:56.029082 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-44d20e73-0ad0-4dcb-930d-5b6279ba8938 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:56.030499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-44d20e73-0ad0-4dcb-930d-5b6279ba8938 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:56.173360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-44d20e73-0ad0-4dcb-930d-5b6279ba8938 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:56.194969 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-44d20e73-0ad0-4dcb-930d-5b6279ba8938 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1217 microversion: 2.1 time: 0.171626 Dec 08 11:33:56.208791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 190/383] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:56 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:56.616162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:56.617138 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:56.638220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:56.640599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:56.642345 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:56.642991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:56.774018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:56.776970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:56.793317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:56.794057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:56.797347 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:56.800239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:57.006140 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-640c9f87-7e51-483f-97f2-ec619306f1e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.248582 Dec 08 11:33:57.017522 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 191/384] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:56 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:57.036032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:57.037958 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:57.056762 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:57.057538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:57.058505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:57.060435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:57.226973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-609eb736-eb2c-46fc-8e3d-4f431f9bcb7d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.206802 Dec 08 11:33:57.228370 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 192/385] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:57 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:57.235110 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:57.236210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:57.246019 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:57.246827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:57.247927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:57.248701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:57.276923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:57.291353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-24889409-5f4b-4e0f-883e-47ce7b9355bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.672991 Dec 08 11:33:57.309346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 194/386] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:56 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:57.414610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:57.427651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cc3c752e-affe-4f4e-885b-40614347b659 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1213 microversion: 2.1 time: 0.197711 Dec 08 11:33:57.428453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 193/387] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:57 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:58.052141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:58.065700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:58.074700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.075532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.078066 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.078772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.244449 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b8229933-e0d9-4341-ac24-ea42586c48a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.218810 Dec 08 11:33:58.245305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 195/388] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:58 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:58.245745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:58.247651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:58.280291 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.281045 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.282386 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.290163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.308233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:58.309843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:58.329705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.331558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.332586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.333374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.484505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5ec114c2-8a28-41a0-a1ef-ec1898f308cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.249155 Dec 08 11:33:58.486674 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 194/389] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:58 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:58.499263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:58.502871 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:58.512901 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.513597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.514440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:58.515107 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:58.712966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:58.723777 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e88c83aa-b879-4530-802a-0778e0a58cb0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1275 microversion: 2.1 time: 0.235765 Dec 08 11:33:58.724350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 195/390] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:58 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1275 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:33:58.958621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:33:58.969985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2d751748-2ac6-486d-b923-73a26e273022 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.663658 Dec 08 11:33:58.970888 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 196/391] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:58 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:33:59.259471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:59.260570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:59.275627 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.276729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:59.278230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.279682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:59.402984 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-365533e0-5dbe-4c1e-8299-1926eda0934c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.148856 Dec 08 11:33:59.409044 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 196/392] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:33:59 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:33:59.501438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:59.503553 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:59.510939 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.511645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:59.512601 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.513234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:59.581658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:33:59.584097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:33:59.584097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:33:59.603126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.606424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:59.609221 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d255861e-85ac-463b-98db-0459043f46d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.110052 Dec 08 11:33:59.610907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 197/393] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:33:59 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:33:59.648425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 service nova] Creating event network-changed:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:33:59.661689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083136 Dec 08 11:33:59.663549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 197/394] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:33:59.742663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:33:59.743681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:33:59.796799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.798532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:33:59.801890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:33:59.811031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:00.004494 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:00.005464 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:00.023484 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:00.023958 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:00.027081 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:00.027616 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:00.828411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:00.843427 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 1.104794 Dec 08 11:34:00.844024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 198/395] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:59 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:00.849350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:00.854642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:00.866861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:00.867389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:00.868632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:00.869761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:00.937350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:00.956416 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f0193942-e88b-4fe8-adf9-08351327569c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.964461 Dec 08 11:34:00.957079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 198/396] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:33:59 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:00.965889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:00.967157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:00.979497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:00.980563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:00.981851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:00.982523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:01.021270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-41d240fe-380a-4751-b332-d3583d478261 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.175655 Dec 08 11:34:01.021912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 199/397] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:00 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:01.322893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-796159ca-c0f1-4cc1-a44b-2cf0c19b4606 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.364172 Dec 08 11:34:01.324106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 199/398] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:00 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:01.865009 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:01.866679 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:01.876669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:01.877581 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:01.878672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:01.880080 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:01.974573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:01.976097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:01.989614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:01.992274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:01.995311 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:01.996514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.295825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:02.305066 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.447695 Dec 08 11:34:02.306582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 200/399] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:01 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:02.312836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:02.317398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:02.325795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.326933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.328389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.329620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.360519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:02.374497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bafa7d0b-39d8-44c7-a630-63585b144b4d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.401737 Dec 08 11:34:02.385022 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 200/400] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:01 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:02.389821 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-cdf7e173-6bd8-4949-8e62-b342babad916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "tag": "be511646-f492-43f2-af08-bc641afcd8a2"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:02.391375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:34:02.391375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:34:02.401883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-cdf7e173-6bd8-4949-8e62-b342babad916 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.402593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-cdf7e173-6bd8-4949-8e62-b342babad916 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.415136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-cdf7e173-6bd8-4949-8e62-b342babad916 service nova] Creating event network-changed:be511646-f492-43f2-af08-bc641afcd8a2 for instance 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 on hv-cinder-81977 Dec 08 11:34:02.420548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-cdf7e173-6bd8-4949-8e62-b342babad916 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033988 Dec 08 11:34:02.421341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 201/401] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:34:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:02.427801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2138933485"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:02.428594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:02.435279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.435763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.436534 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.436964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.446370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d2a49ae1-bee3-48bb-b0c8-deb5b3a75100 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.137818 Dec 08 11:34:02.447324 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 201/402] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:02 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:02.455786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:02.457067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:02.463477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.464146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.465092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:02.465736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:02.555743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-889add4e-9370-4720-832a-b1b826b7b297 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 28637 microversion: 2.1 time: 0.105740 Dec 08 11:34:02.557212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 202/403] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:02 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 28637 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:02.690309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.network.security_group_api [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Adding security group 7c872497-d719-4618-a000-bf3059a98a01 to port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec Dec 08 11:34:03.277726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-34683753-3e58-4a24-81b3-b43c1c88f293 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/action" status: 202 len: 0 microversion: 2.1 time: 0.855001 Dec 08 11:34:03.278627 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 202/404] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:02 2021] POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/action => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:03.291389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:03.292364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:03.314280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.314928 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.317382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.317382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.322239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:03.322852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:03.337673 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.338139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.338938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.339384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.788560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:03.795081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:03.802858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.484020 Dec 08 11:34:03.808323 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-35193380-f519-4e6d-9897-9937515fa9c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1758 microversion: 2.1 time: 0.522284 Dec 08 11:34:03.810056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 203/405] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:03 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1758 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:03.812483 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 203/406] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:03 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:03.817089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:03.818163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:03.821285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:03.822928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:03.825565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.826430 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.827464 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.828280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.834547 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.835208 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.838114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.838735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.939263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-91d88bfb-0df8-4112-8812-f67067af1c59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.125343 Dec 08 11:34:03.940596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 204/407] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:03 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:03.946198 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:03.947471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:03.956126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.956895 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:03.957981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:03.958576 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:04.001193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:04.012640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.201287 Dec 08 11:34:04.024563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 204/408] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:03 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:04.075395 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b90898b9-3f86-4b0f-8848-39c233fb5de5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 29183 microversion: 2.1 time: 0.132878 Dec 08 11:34:04.079309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 205/409] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:03 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 29183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:04.437203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:04.438935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:34:04.438935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:34:04.446975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:04.447539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:04.459118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb service nova] Creating event network-changed:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:34:04.464478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Dec 08 11:34:04.465057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 205/410] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:04.820420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:04.821132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:04.828188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:04.828879 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:04.830398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:04.830981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:04.952203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:04.953614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:04.961586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:04.962140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:04.963175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:04.963846 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:05.076573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-abe245aa-76f2-4a0f-b317-632162444dc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.128620 Dec 08 11:34:05.077500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 206/411] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:04 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:05.087743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:05.092596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:05.103479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:05.104484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:05.105388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:05.106248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:05.436762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:05.446231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.367237 Dec 08 11:34:05.446880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 207/412] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:05 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:05.453944 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:05.464998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:05.467470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:05.476479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:05.476940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:05.478362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.661540 Dec 08 11:34:05.479249 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 206/413] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:04 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:05.480021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:05.480474 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:05.588411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0224aeca-7a53-47d6-9c7c-3aac7dd20807 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 30528 microversion: 2.1 time: 0.128432 Dec 08 11:34:05.589347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 208/414] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:05 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 30528 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:06.134819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:06.135769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:06.143586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.144042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.144831 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.145451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.236626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0c509dc5-3d91-4993-b30f-79422115e5f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.105395 Dec 08 11:34:06.237432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 207/415] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:06 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:34:06.465761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:06.467060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:06.474532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.475077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.475785 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.476227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.495908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:06.496616 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:06.504314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.505208 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.506007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.506452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.742056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:06.746611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:06.750660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.289234 Dec 08 11:34:06.751919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 209/416] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:06 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:06.754754 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bb560642-6ab1-4c19-bef9-f237bd8065aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.262691 Dec 08 11:34:06.755647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 208/417] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:06 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:06.762138 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:06.763068 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:06.771205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.771656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.772500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:06.772935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:06.890948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5dba7c6d-caad-4c43-a40f-e3bbf4ba0e81 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 31794 microversion: 2.1 time: 0.137591 Dec 08 11:34:06.893370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 210/418] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:06 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 31794 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:07.247695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:07.248784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:07.256749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:07.257236 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:07.258325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:07.259055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:07.340960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-928ced1e-c40e-478c-ae6f-cd3ccde2c781 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.096592 Dec 08 11:34:07.341606 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 209/419] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:07 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:07.778621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:07.779811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:07.780567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:07.785313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:07.792474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:07.792654 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:07.793026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:07.793178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:07.793960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:07.794074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:07.794449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:07.794570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:08.004719 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:08.005310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:08.015118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.245169 Dec 08 11:34:08.015318 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-198e1f9a-7a27-4b41-89ac-70fe8474f362 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.245647 Dec 08 11:34:08.016089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 211/420] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:07 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:08.016222 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 210/421] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:07 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:08.020511 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:08.021463 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:08.027550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:08.028011 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:08.028880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:08.029298 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:08.130348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cbd36fa4-bde7-48dd-8727-b47941798b6c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 32719 microversion: 2.1 time: 0.113343 Dec 08 11:34:08.130995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 212/422] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:08 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 32719 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:08.352495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:08.353438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:08.360205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:08.360663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:08.361482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:08.361925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:08.439876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8667982d-eb21-4673-8fed-59166ed391b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.090825 Dec 08 11:34:08.440830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 211/423] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:08 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:09.032308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:09.033600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:09.035947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:09.036760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:09.040883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.041384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.042182 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.042638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.045246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.045974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.047066 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.047881 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.249604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:09.257140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-39916e36-420f-4363-840c-b422440bbcaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.228991 Dec 08 11:34:09.263068 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:09.267873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 213/424] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:09 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:09.272624 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.243157 Dec 08 11:34:09.272779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:09.273197 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 212/425] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:09 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:09.273798 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:09.280055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.280451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.281326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.281724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.380770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d788797e-aa66-4c45-993c-8b8d8626d324 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 33331 microversion: 2.1 time: 0.111255 Dec 08 11:34:09.381795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 214/426] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:09 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 33331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:09.452495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:09.453708 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:09.461897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.462446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.463323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:09.463929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:09.568949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0801a137-9aac-4b96-bd9d-fe892fedd6fd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.120252 Dec 08 11:34:09.573852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 213/427] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:09 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:10.274331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:10.274997 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:10.284562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.285046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.286116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.286566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.290179 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:10.290899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:10.299480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.299937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.300745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.301235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.524975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:10.532480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:10.533026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.262529 Dec 08 11:34:10.542397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 215/428] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:10 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:10.542397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:10.542397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:10.542757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2b1b1498-d657-4642-ab85-dcf074e844b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.253686 Dec 08 11:34:10.542757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 214/429] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:10 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:10.546000 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.546000 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.546716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.547175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.582285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:10.583293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:10.590241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.590708 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.591515 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:10.591960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:10.646595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d525ef3c-b659-4177-bb49-e176392d092b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 33712 microversion: 2.1 time: 0.111497 Dec 08 11:34:10.647820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 216/430] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:10 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 33712 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:10.714190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e3132067-7131-426d-8d4d-a882131b3b5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.135744 Dec 08 11:34:10.715775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 215/431] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:10 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:11.550928 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:11.554725 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:11.558788 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:11.559400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:11.563204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.563687 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.564490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.564984 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.565963 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.566442 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.567219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.567751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.808043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:11.816097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:11.816366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9a19cafc-5a6d-458d-a761-dd17374737e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.261959 Dec 08 11:34:11.817189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 216/432] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:11 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:11.822129 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:11.823153 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:11.823574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d1784eb4-d368-474c-a5ee-71cdec34fe18 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.277081 Dec 08 11:34:11.828912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 217/433] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:11 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:11.828912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:11.829323 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:11.829699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.830220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.830839 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.831284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.835874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.836329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.837123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:11.837582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:11.937157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-843a87c2-edf0-46af-aa4e-79c43b3b6198 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 34959 microversion: 2.1 time: 0.118642 Dec 08 11:34:11.937886 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 217/434] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:11 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 34959 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:11.944658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-66b0c670-3d4c-4506-a2de-a984fff4ddd9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 28633 microversion: 2.20 time: 0.119128 Dec 08 11:34:11.948418 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 218/435] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:11 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 28633 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:12.835596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:12.841110 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:12.841845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:12.845060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:12.853129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:12.853643 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:12.854459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:12.854944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:12.863210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:12.863677 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:12.864502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:12.864943 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:13.073200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:13.076306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:13.087271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.256674 Dec 08 11:34:13.091824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.254747 Dec 08 11:34:13.101651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 218/436] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:12 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:13.102188 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 219/437] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:12 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:13.102545 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:13.103472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:13.107477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:13.108669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:13.112294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:13.112900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:13.113585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:13.114027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:13.115500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:13.115970 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:13.116786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:13.117249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:13.208749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bcc81193-7a0d-4015-96f5-bbfd02aa90f0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 35522 microversion: 2.1 time: 0.111707 Dec 08 11:34:13.209423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 219/438] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:13 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 35522 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:13.261265 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cd0edec2-bae9-4703-8fca-3f10992d2793 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 29589 microversion: 2.20 time: 0.157272 Dec 08 11:34:13.262463 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 220/439] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:13 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 29589 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:14.110100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:14.111590 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:14.112016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:14.112781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:14.118892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.119348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.119784 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.120453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.120581 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.120669 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.120998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.121466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.357508 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:14.368872 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-24da0871-8d10-4513-bb9d-8b717592f6e6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.262992 Dec 08 11:34:14.369368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:14.379134 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.271073 Dec 08 11:34:14.380271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 220/440] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:14 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:14.384698 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 221/441] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:14 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:14.391751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:14.393801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:14.394301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:14.399120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:14.405403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.406456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.408130 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.409118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.413720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.414236 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.415319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:14.415763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:14.527580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6a6505e6-9f3c-4d20-a700-acccb6d2cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 30917 microversion: 2.20 time: 0.143662 Dec 08 11:34:14.528750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 222/442] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:14 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 30917 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:14.576151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e96e7ca8-c2f6-486b-88d1-a4f033d040b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 36493 microversion: 2.1 time: 0.194431 Dec 08 11:34:14.577644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 221/443] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:14 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 36493 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:15.397168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:15.397938 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:15.409165 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.411266 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.412391 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.412943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.415476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:15.416572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:15.430938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.435568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.439149 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.440385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.687792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:15.692610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:15.695619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.302899 Dec 08 11:34:15.696598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 223/444] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:15 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:15.705760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2f99af05-b4f5-4560-abe9-708e4665b957 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.295027 Dec 08 11:34:15.706600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 222/445] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:15 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:15.710940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:15.711495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:15.712617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:15.715229 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:15.719865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.721093 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.721870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.722317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.728004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.728661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.729666 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:15.730111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:15.823287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b1ec6c9c-f774-4bf2-9ba1-0d1ad1d3ed40 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 37308 microversion: 2.1 time: 0.115364 Dec 08 11:34:15.823959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 223/446] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:15 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 37308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:15.861671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6efc43dd-6064-473e-80a7-16de0b2a4377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 32044 microversion: 2.20 time: 0.162534 Dec 08 11:34:15.863540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 224/447] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:15 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 32044 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:16.714651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:16.715443 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:16.729790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:16.730603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:16.743499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:16.744553 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:16.745870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:16.746783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:16.755544 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:16.756097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:16.756947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:16.757607 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:17.005282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:17.013433 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ace11f34-a75d-439d-b86b-12116d22a4fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.302926 Dec 08 11:34:17.014023 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 224/448] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:16 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:17.019557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:17.019939 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:17.020261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:17.026916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:17.027514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:17.028315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:17.028759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:17.029349 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c0ed1193-6b80-4699-aef1-94929369f1ea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.306101 Dec 08 11:34:17.030206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 225/449] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:16 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:17.042855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:17.043841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:17.052370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:17.052965 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:17.053876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:17.054608 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:17.236959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c1f3c960-1f69-4e4f-bdd6-9298378299d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 33089 microversion: 2.20 time: 0.205256 Dec 08 11:34:17.238179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 226/450] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:17 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 33089 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:17.270797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-487b4e89-37dd-49dd-bc7f-db3e29777fee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 38130 microversion: 2.1 time: 0.255512 Dec 08 11:34:17.275340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 225/451] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:17 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 38130 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:18.034137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:18.034844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:18.045025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.045737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.046288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.046872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.049591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:18.052093 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:18.061568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.062208 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.063212 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.063951 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.267507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:18.271184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:18.275407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.247338 Dec 08 11:34:18.276057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 227/452] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:18 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:18.278586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.236190 Dec 08 11:34:18.279355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 226/453] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:18 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:18.282659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:18.283574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:18.287195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:18.288177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:18.289350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.289800 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.290578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.291008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.293991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.294440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.295241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:18.295671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:18.449661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d0a75373-55ee-4134-8a00-6c692338291f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 38130 microversion: 2.1 time: 0.167054 Dec 08 11:34:18.450252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 227/454] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:18 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 38130 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:34:18.504455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-325d296b-5aef-4dc7-b02a-67f4d7e1f305 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 33490 microversion: 2.20 time: 0.227159 Dec 08 11:34:18.505101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 228/455] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:18 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 33490 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:19.295543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:19.296252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:19.298742 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:19.299584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:19.303183 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.303642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.304434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.304869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.306731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.307191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.307991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.308432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.511867 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:19.521661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:19.522346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4960437d-269b-4d9b-8ac9-60917eed6140 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.230077 Dec 08 11:34:19.529253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 229/456] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:19 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:19.534529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:19.535879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:19.540759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fba73217-3c8b-4058-bcaa-6d60bf7802ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.252488 Dec 08 11:34:19.541572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 228/457] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:19 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:19.547024 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:19.548669 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:19.551815 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.552295 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.553133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.553609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.555078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.555521 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.556405 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:19.556741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:19.685143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-51c5d8ea-1b3d-43ba-8f8c-dd05ac4f387f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 33936 microversion: 2.20 time: 0.142142 Dec 08 11:34:19.685803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 229/458] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:19 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 33936 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:19.692627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-989f661d-36c8-4fe1-9710-bd51eaa2193f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 38130 microversion: 2.1 time: 0.161865 Dec 08 11:34:19.697348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 230/459] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:19 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 38130 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:20.540690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:20.541410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:20.548217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.548666 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.549472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.549913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.558093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:20.558792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:20.565632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.566085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.567512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.567512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.745533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:20.754099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:20.754313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-44440c82-1b73-40d3-afcd-b1668d30f230 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1523 microversion: 2.1 time: 0.199792 Dec 08 11:34:20.754555 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 231/460] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:20 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:20.759660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:20.760582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:20.774603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.775935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.776904 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.777542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.779275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fd74a8b9-3744-499b-acd9-f485ed0eec3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.242559 Dec 08 11:34:20.780948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 230/461] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:20 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:20.801476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:20.802603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:20.816103 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.816867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.817982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.818436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.901369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dd95adfa-b3f6-488e-87b2-1b9325602635 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 34549 microversion: 2.20 time: 0.145542 Dec 08 11:34:20.902141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 232/462] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:20 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 34549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:20.945961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8b0cdc45-19df-4ad0-be44-ad3fc8b1aa4d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 200 len: 38261 microversion: 2.1 time: 0.151953 Dec 08 11:34:20.946609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 231/463] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:20 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 38261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:34:20.957871 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:20.958499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:20.965909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.966359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.967148 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:20.967587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:20.996911 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d8e72004-16fa-49af-8348-404ae3fd95a2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/ips" status: 200 len: 145 microversion: 2.1 time: 0.042791 Dec 08 11:34:20.998097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 233/464] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Dec 8 11:34:20 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:21.774365 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:21.775708 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:21.783929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:21.784141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:21.785207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:21.785718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:21.796768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:21.797567 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:21.809385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:21.809963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:21.810978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:21.811443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:22.022467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:22.030180 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-58fe58fe-4fc9-407c-8278-24dbdf259ccc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1503 microversion: 2.1 time: 0.261720 Dec 08 11:34:22.031164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 232/465] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:21 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:22.037656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:22.038893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:22.042740 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:22.046040 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:22.046495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:22.047460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:22.048058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:22.051758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0158dc67-dfcc-4c17-8ec1-da347c55d20a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.258325 Dec 08 11:34:22.062569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 234/466] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:21 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:22.067831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:22.068714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:22.077343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:22.078495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:22.085287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:22.086297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:22.154430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bc52e730-10d5-4b6a-873c-e6744e620d19 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 35304 microversion: 2.20 time: 0.121257 Dec 08 11:34:22.158678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 233/467] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:22 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 35304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:22.239817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:22.248521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fddc3430-311b-41cd-882b-7b6b2d9e266c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1515 microversion: 2.1 time: 0.184463 Dec 08 11:34:22.249309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 235/468] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:22 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:23.070836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:23.072271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:23.091147 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:23.092623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:23.099873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:23.100538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:23.168634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:23.169697 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:23.182400 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:23.183142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:23.184691 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:23.186086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:23.290442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7c109106-5953-4c92-916a-a4c862085a3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 36066 microversion: 2.20 time: 0.125556 Dec 08 11:34:23.291507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 236/469] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:23 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 36066 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:23.307677 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:23.315643 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.249554 Dec 08 11:34:23.316945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 234/470] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:23 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:24.302595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:24.303582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:24.312526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.312977 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.313794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.314228 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.333325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:24.333955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:24.340297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.340760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.341586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.342020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.486195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:24.493297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4626175c-a791-4d5f-870a-9315c231edd6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.164393 Dec 08 11:34:24.493873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 235/471] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:24 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:24.552178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dba4bcec-4335-42c0-bcb0-8a71ac92e083 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 37205 microversion: 2.20 time: 0.253458 Dec 08 11:34:24.552828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 237/472] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:24 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 37205 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:24.661957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:24.662914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:24.669137 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.669618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.670399 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.670832 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.694104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lazy-loading 'flavor' on Instance uuid ef74eb6c-4764-40c3-8610-e4f4bc3e610d {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:34:24.808719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-565ca181-39d9-4a44-b13e-187478f01e17 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action" status: 200 len: 32 microversion: 2.1 time: 0.149371 Dec 08 11:34:24.808719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 236/473] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:24 2021] POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:34:24.818723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:24.819501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:24.826909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.827448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:24.828339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:24.829042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:25.069952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:25.077745 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.263046 Dec 08 11:34:25.078296 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 238/474] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:24 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:25.511414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:25.512221 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:25.519868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:25.520346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:25.521591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:25.522038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:25.563735 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:25.564912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:25.572094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:25.572633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:25.573518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:25.574019 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:25.657952 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:25.665404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9adfee50-3434-4ddd-9130-f5bd43639cc8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.158604 Dec 08 11:34:25.666312 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 237/475] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:25 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:25.774189 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-74e4303b-a1d0-493a-89d0-5487bd6658d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 38136 microversion: 2.20 time: 0.213905 Dec 08 11:34:25.774840 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 239/476] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:25 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 38136 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:34:26.095572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:26.096191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:26.102105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.102843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.103637 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.104075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.202860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-776d65d9-905b-41bd-aa71-2dfb214bd362 req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "name": "network-vif-plugged", "status": "completed", "tag": "be511646-f492-43f2-af08-bc641afcd8a2"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:26.205992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:34:26.205992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:34:26.215139 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-776d65d9-905b-41bd-aa71-2dfb214bd362 req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.215587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-776d65d9-905b-41bd-aa71-2dfb214bd362 req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.230574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-776d65d9-905b-41bd-aa71-2dfb214bd362 req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af service nova] Creating event network-vif-plugged:be511646-f492-43f2-af08-bc641afcd8a2 for instance 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 on hv-cinder-81977 Dec 08 11:34:26.234802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-776d65d9-905b-41bd-aa71-2dfb214bd362 req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036443 Dec 08 11:34:26.235645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 240/477] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:34:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:26.246689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:26.254881 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.163345 Dec 08 11:34:26.255728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 238/478] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:26 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:26.684522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:26.685280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:26.692402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.692848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.693865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.694302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.786527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:26.787652 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:26.793984 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.794516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.795465 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:26.795998 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:26.824455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:26.831804 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a383df33-6c2c-4c43-98bf-8a3a1160e78c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.151774 Dec 08 11:34:26.832354 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 241/479] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:26 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:27.029543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a366348d-bfd1-42fa-ad40-a3a20ffbefc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 38136 microversion: 2.20 time: 0.246639 Dec 08 11:34:27.030091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 239/480] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:26 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 38136 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:34:27.272602 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:27.273230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:27.279508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:27.279897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:27.280666 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:27.281099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:27.411701 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:27.418945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.150112 Dec 08 11:34:27.419498 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 242/481] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:27 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:27.575632 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d530645a-3422-4f8e-b2a6-22eafb01384e"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:27.576772 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:27.584127 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:27.584581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:27.585385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:27.585822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:27.848058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:27.848881 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:27.852723 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6e0d9df4-d53a-4849-afc0-098f90808098 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280587 Dec 08 11:34:27.855683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:27.856105 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:27.857092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:27.857710 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:27.858562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 240/482] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:34:27 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:28.011664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:28.020414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8961da63-e5f7-4373-b830-cac295cfc8cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.176120 Dec 08 11:34:28.021062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 243/483] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:27 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:28.042610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:28.043719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:28.050868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:28.051331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:28.053096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:28.053656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:28.191065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5361d397-9307-4dd5-a0f4-bcb2aa13bab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 38136 microversion: 2.20 time: 0.152498 Dec 08 11:34:28.192686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 241/484] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:28 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 38136 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:28.435747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:28.436522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:28.442734 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:28.443281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:28.444130 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:28.444628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:28.592289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:28.600749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-014abe8e-8faa-4f99-8ab6-d0542461ee7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.168594 Dec 08 11:34:28.601350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 244/485] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:28 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:29.037436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:29.038148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:29.044917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:29.045400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:29.046184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:29.046627 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:29.201274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:29.203361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:29.205184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:29.210426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-89834f93-ab95-43bc-893a-ad06d573e3c3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1317 microversion: 2.1 time: 0.176937 Dec 08 11:34:29.211243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 242/486] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:29 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:29.211970 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:29.212419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:29.213417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:29.213858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:29.326423 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-01843363-667e-4632-83b2-6f040f4c624c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 38156 microversion: 2.20 time: 0.127082 Dec 08 11:34:29.330780 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 245/487] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:29 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 38156 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:34:29.616452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:29.617220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:29.623253 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:29.623707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:29.624485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:29.624921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:29.768584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:29.775736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3116bd59-6103-4ecc-b341-8a453fcc0905 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.162817 Dec 08 11:34:29.776286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 243/488] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:29 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:30.227685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:30.228336 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:30.235800 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.236245 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.237022 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.237477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.338761 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:30.340151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:30.347233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.347793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.348669 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.349207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.371422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:30.381033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-336e6139-b0be-4f95-a4a8-3bc311516ee1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1505 microversion: 2.1 time: 0.157315 Dec 08 11:34:30.381641 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 246/489] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:30 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:30.447728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-29fb58b2-fcc8-482e-a8bc-67e1fb27497a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 200 len: 38275 microversion: 2.20 time: 0.112765 Dec 08 11:34:30.448617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 244/490] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:30 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 38275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:34:30.459145 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:30.459634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:30.465514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.465964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.466780 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.467305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.504456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3af8e601-8fe7-45b1-98e5-181f462ad6bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/ips" status: 200 len: 151 microversion: 2.20 time: 0.048821 Dec 08 11:34:30.504938 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 247/491] 10.222.0.66 () {60 vars in 1288 bytes} [Wed Dec 8 11:34:30 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:34:30.798261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:30.799663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:30.807552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.808096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.808996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:30.809563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:30.948626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:30.956100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2a510efd-700f-48a2-be99-c18ff8828102 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.163757 Dec 08 11:34:30.956663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 245/492] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:30 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:31.972177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:31.972689 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:31.979562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:31.980392 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:31.981389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:31.982350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:32.117026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:32.124603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3189da8b-4645-49f8-8449-8ba9d0d014a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.156248 Dec 08 11:34:32.125184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 248/493] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:31 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:32.793689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e194386-1f14-46a5-b5b9-eac4edc47c12"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:32.794762 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:32.800993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:32.801492 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:32.802285 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:32.802729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:33.045533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b99d30d4-0dee-4fa5-b4aa-64c78094902f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255383 Dec 08 11:34:33.046133 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 246/494] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:34:32 2021] POST /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:33.142527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:33.143397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:33.149647 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:33.150108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:33.150898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:33.151342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:33.280768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:33.289005 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-418f8f75-a06a-4475-a572-e8c1afc1eb55 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.150735 Dec 08 11:34:33.289599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 249/495] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:33 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:34.306769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:34.307463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:34.315994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:34.316438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:34.317239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:34.317675 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:34.455018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:34.462172 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0183c812-1b55-460d-a890-3491e65222be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.159822 Dec 08 11:34:34.462739 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 247/496] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:34 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:35.479008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:35.479619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:35.486104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:35.486560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:35.487525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:35.487972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:35.613362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:35.620504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4bea3649-646e-49d0-8168-6510a1bd3493 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.145076 Dec 08 11:34:35.621067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 250/497] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:35 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:36.636947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:36.637583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:36.644717 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:36.645193 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:36.645980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:36.646423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:36.772572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:36.779861 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.146522 Dec 08 11:34:36.780426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 248/498] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:36 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:37.795476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:37.796032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:37.802213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:37.802661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:37.803427 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:37.803857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:37.929115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:37.936670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.144806 Dec 08 11:34:37.937246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 251/499] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:37 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:38.953768 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:38.954376 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:38.960567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:38.961020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:38.961857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:38.962296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:39.093258 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:39.101398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2c638597-4d4b-4dec-afc5-6abf88e43814 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.151153 Dec 08 11:34:39.101967 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 249/500] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:38 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:40.118326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:40.118930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:40.125185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:40.125638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:40.126406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:40.126844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:40.255834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:40.263097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.148366 Dec 08 11:34:40.263640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 252/501] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:40 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:40.836751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:40.837336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:40.843521 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:40.843974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:40.844755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:40.845224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:40.866861 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lazy-loading 'flavor' on Instance uuid 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:34:41.152162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e7dd9e97-a016-4429-9128-2bc6446760c4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 202 len: 0 microversion: 2.20 time: 0.318723 Dec 08 11:34:41.155918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 250/502] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:34:40 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:34:41.163112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:41.163727 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:41.177739 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.178418 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.179571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.180792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.279979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:41.280679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:41.286901 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.287352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.288383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.288827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.327475 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:41.335433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:41.337083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:41.338283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.180832 Dec 08 11:34:41.339094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 253/503] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:41 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:41.430469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:41.439876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.163775 Dec 08 11:34:41.440641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 251/504] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:41 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:41.623328 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fdf362c0-e17d-45be-8dab-df822f4fb97c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:41.629320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fdf362c0-e17d-45be-8dab-df822f4fb97c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.629728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fdf362c0-e17d-45be-8dab-df822f4fb97c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.688562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fdf362c0-e17d-45be-8dab-df822f4fb97c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Going to try to stop instance {{(pid=117270) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 08 11:34:41.729729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fdf362c0-e17d-45be-8dab-df822f4fb97c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 202 len: 0 microversion: 2.1 time: 0.109739 Dec 08 11:34:41.730319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 254/505] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:41 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:41.738078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:41.738776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:41.744829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.745417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.746363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:41.746931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:41.882249 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:41.889992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.155568 Dec 08 11:34:41.890562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 252/506] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:41 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:42.260707 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed51d092-6543-4e59-a977-5df91a73d42b", "device": "/dev/sdb"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:42.262502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:42.269237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.269683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.270598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.271036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.356451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:42.357060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:42.362855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.363819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.364597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.365034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.512806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:42.521976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:42.523666 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:42.524830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.172047 Dec 08 11:34:42.535513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 253/507] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:42 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:42.539898 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:42.540540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:42.547026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.547533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.549097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.550014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.559444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c632ff6f-ffe3-4626-b135-ca0a5001840a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "POST /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303353 Dec 08 11:34:42.560402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 255/508] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:34:42 2021] POST /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:42.698911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:42.707303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.180270 Dec 08 11:34:42.707871 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 254/509] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:42 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:42.908797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:42.909478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:42.915579 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.916039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:42.916829 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:42.917392 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:43.052620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:43.060333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0d0869b7-c72e-4760-b381-935fd342790e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.156093 Dec 08 11:34:43.060893 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 256/510] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:42 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:43.543681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:43.544293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:43.552700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:43.553174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:43.554030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:43.554470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:43.705288 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:43.713667 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:43.715154 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:43.716303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.177036 Dec 08 11:34:43.716854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 255/511] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:43 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:43.725719 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:43.726487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:43.732529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:43.733058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:43.733959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:43.734467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:43.871803 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:43.879824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8accf8ae-453f-4dbf-9aed-1e8a39669997 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.158128 Dec 08 11:34:43.880392 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 257/512] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:43 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:44.078264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:44.079073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:44.089620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:44.090086 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:44.090905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:44.091381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:44.239293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:44.247538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-50d98ac3-924f-483e-a8b0-20d3e414b7bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.172939 Dec 08 11:34:44.248116 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 256/513] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:44 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:44.734361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:44.734963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:44.741087 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:44.741563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:44.742329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:44.742762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:44.880299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:44.887903 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:44.889410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:44.890534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-39b6336c-159e-455f-98e8-1c8e58bc5e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.159808 Dec 08 11:34:44.891079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 258/514] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:44 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:44.896665 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:44.897313 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:44.903530 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:44.903922 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:44.904703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:44.905143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:45.030326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:45.037463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.145365 Dec 08 11:34:45.038021 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 257/515] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:44 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:45.265577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:45.266115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:45.272152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:45.272599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:45.273407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:45.273845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:45.627526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:45.635674 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0f645636-e165-4343-91a1-d8ea773a8c5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.373850 Dec 08 11:34:45.636231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 259/516] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:45 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:45.908843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:45.909475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:45.915607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:45.916060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:45.916835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:45.917304 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:46.041674 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:46.049342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:46.051318 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:46.052464 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.147270 Dec 08 11:34:46.053014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 258/517] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:45 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:46.054566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:46.055234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:46.061397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:46.061851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:46.062633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:46.063070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:46.190952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:46.198113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a0d3d39b-c944-45f5-9937-75fc09d91c72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.147706 Dec 08 11:34:46.198667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 260/518] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:46 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:46.653210 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:46.653818 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:46.660216 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:46.660665 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:46.661469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:46.661908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:46.790151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:46.798123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.148566 Dec 08 11:34:46.798685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 259/519] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:46 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:47.070595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:47.071203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:47.077520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.078060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.078844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.079284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.210517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:47.214689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:47.215291 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:47.218206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:47.219683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:47.220818 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.153878 Dec 08 11:34:47.221386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 261/520] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:47 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:47.221503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.221922 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.222823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.223264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.351644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:47.358834 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ef9c7686-db31-43ff-8567-7d535dc34cf4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1501 microversion: 2.1 time: 0.147649 Dec 08 11:34:47.359392 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 260/521] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:47 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:47.375268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "385b39dd-2a92-4d6d-8a41-52454fe5cee2"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:47.376408 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:47.382881 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.383328 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.384097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.384536 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.406519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] HTTP exception thrown: Cannot 'attach_volume' instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d while it is in vm_state rescued Dec 08 11:34:47.407094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Returning 409 to user: Cannot 'attach_volume' instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d while it is in vm_state rescued {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:34:47.407896 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f9ef154e-7580-4561-af68-4b7761f60e24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.036475 Dec 08 11:34:47.408406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 262/522] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:34:47 2021] POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 152 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 08 11:34:47.416317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:47.416848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:47.422595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.423046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.423831 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.424272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.490745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action" status: 202 len: 0 microversion: 2.1 time: 0.077704 Dec 08 11:34:47.491293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 261/523] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:34:47 2021] POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:47.499130 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:47.499854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:47.506445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.506898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.507684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.508122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.707684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:47.715443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1509 microversion: 2.1 time: 0.219993 Dec 08 11:34:47.716192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 263/524] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:47 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:47.815546 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:47.816912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:47.823043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.823567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:47.824420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:47.824932 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:48.030163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:48.037883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-486f5abf-3e53-4239-9c68-dee80f72f223 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.226337 Dec 08 11:34:48.038448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 262/525] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:47 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:48.239865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:48.240492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:48.246858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:48.247252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:48.248031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:48.248467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:48.378595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:48.386271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:48.387772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:48.388920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-77cfca3d-1186-46f5-8d17-ecc899f13721 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.154364 Dec 08 11:34:48.389502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 264/526] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:48 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:48.732119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:48.732728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:48.738991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:48.739438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:48.740207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:48.740646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:48.868638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:48.875740 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1509 microversion: 2.1 time: 0.147275 Dec 08 11:34:48.876292 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 263/527] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:48 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:49.054435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:49.055043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:49.060753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:49.061234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:49.062019 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:49.062460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:49.194809 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:49.202499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-72124b5c-cd76-4fa2-9acf-15e61503b0ee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.151628 Dec 08 11:34:49.203058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 265/528] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:49 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:49.406861 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:49.407495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:49.413284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:49.413729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:49.414495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:49.414923 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:49.539028 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:49.546767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:49.548258 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:49.549430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e3d48e37-d348-4cce-875f-a0ca9274303c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.146154 Dec 08 11:34:49.550475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 264/529] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:49 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:49.892806 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:49.893622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:49.899978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:49.900435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:49.901248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:49.901690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:49.993114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e194386-1f14-46a5-b5b9-eac4edc47c12"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:49.994363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:50.000642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.000956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.002005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.002439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.034045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:50.042125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1509 microversion: 2.1 time: 0.153323 Dec 08 11:34:50.042679 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 266/530] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:49 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:50.078880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] HTTP exception thrown: Invalid volume: volume 8e194386-1f14-46a5-b5b9-eac4edc47c12 is already attached to instances: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 Dec 08 11:34:50.079701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Returning 400 to user: Invalid volume: volume 8e194386-1f14-46a5-b5b9-eac4edc47c12 is already attached to instances: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:34:50.080647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-08eac805-f58e-4de3-992c-c49133886241 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091323 Dec 08 11:34:50.084564 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 265/531] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:34:49 2021] POST /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 08 11:34:50.167085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:50.167617 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:50.173520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.173973 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.174779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.175815 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.219557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:50.220092 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:50.226622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.227302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.228407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.229200 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.300415 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'services' on Instance uuid 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:34:50.370900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:50.379281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bbb666d9-357c-4c4b-a68d-d8d57218a678 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.163399 Dec 08 11:34:50.379836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 266/532] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:50 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:50.408897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1c883e94-13b8-4bc5-b258-549136052dbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments/8e194386-1f14-46a5-b5b9-eac4edc47c12" status: 202 len: 0 microversion: 2.1 time: 0.245539 Dec 08 11:34:50.409565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 267/533] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:34:50 2021] DELETE /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments/8e194386-1f14-46a5-b5b9-eac4edc47c12 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:34:50.417706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:50.418772 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:50.424639 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.425726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.426578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.427091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.457568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2b17caeb-f4ac-401b-8d68-6b247fa78b7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Dec 08 11:34:50.458184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 267/534] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:50 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:50.568790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:50.569466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:50.575511 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.575977 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.576762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:50.577248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:50.703282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:50.710920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:50.712411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:50.713605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f384382f-7cce-4e4f-8318-9fc8e476e316 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.149616 Dec 08 11:34:50.714162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 268/535] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:50 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:51.059453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:51.060068 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:51.066208 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.066672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.067455 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.067896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.201781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:51.209498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1509 microversion: 2.1 time: 0.153639 Dec 08 11:34:51.210051 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 268/536] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:51 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:51.396759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:51.397403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:51.403709 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.404487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.404930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.405419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.469381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:51.470399 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:51.476225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.476694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.477507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.477955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.506902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-443720eb-1147-479b-a283-e72a159ccbe6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Dec 08 11:34:51.507470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 269/537] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:51 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:51.535595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:51.543515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.151146 Dec 08 11:34:51.544076 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 269/538] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:51 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:51.731928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:51.732460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:51.738819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.739271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.740059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:51.740502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:51.866426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:51.874885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:51.876417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:51.877600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.149433 Dec 08 11:34:51.878763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 270/539] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:51 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:52.226907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:52.227630 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:52.233402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.233925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.234765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.235264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.367320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:52.374569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ca9c7977-bbed-43d6-a605-f804fba24286 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1509 microversion: 2.1 time: 0.151542 Dec 08 11:34:52.375129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 270/540] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:52 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:52.518401 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:52.519824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:52.526016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.526462 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.527232 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.527697 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.556239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6bee424c-5520-4acd-af59-5f3014277fa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041789 Dec 08 11:34:52.556937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 271/541] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:52 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:52.559486 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:52.560099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:52.566377 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.566828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.567610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.568058 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.697766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:52.705425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ee2433f8-d47d-4898-b9fe-63a95058e844 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.149547 Dec 08 11:34:52.705991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 271/542] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:52 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:52.896767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:52.897316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:52.903029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.903477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:52.904247 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:52.904683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.040075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:53.047874 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:53.049407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:53.050602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.158537 Dec 08 11:34:53.051161 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 272/543] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:52 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:53.390685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:53.391307 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:53.397420 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:53.397880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.398662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:53.399108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.533083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:53.540319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1515 microversion: 2.1 time: 0.153253 Dec 08 11:34:53.540879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 272/544] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:53 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:53.567846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:53.568792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:53.575079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:53.575533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.576319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:53.576754 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.606471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-00923e2b-7a98-4bfc-9521-1e2f33f1e6df tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Dec 08 11:34:53.607035 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 273/545] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:53 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:53.722910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:53.723530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:53.730340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:53.730939 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.731753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:53.732188 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:53.879356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:53.887192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-961218e2-cd4f-4536-9d57-43ef8d0ff45b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.168040 Dec 08 11:34:53.887753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 273/546] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:53 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:54.068715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:54.069268 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:54.074986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.075441 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.076221 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.076662 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.207252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:54.215413 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:54.217077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:54.218122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8bdab52d-2e59-48f4-8668-55305ed695a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.153788 Dec 08 11:34:54.218682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 274/547] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:54 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:54.618297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:54.619267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:54.625103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.625580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.626351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.626785 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.654648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d532e513-5747-4566-b879-e2247aa57e92 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040097 Dec 08 11:34:54.655186 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 274/548] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:54 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:54.850719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:54.851350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:54.857675 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.858130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.858917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.859423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.904841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:54.905423 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:54.911895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.912350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:54.913139 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:54.913618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.029414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:55.036617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1515 microversion: 2.1 time: 0.189523 Dec 08 11:34:55.037391 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 275/549] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:54 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:55.053535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5037143f-89a3-48fa-89eb-c80ecf0c3639"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:55.054590 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:55.060310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.060790 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.061624 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.062088 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.072694 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:55.080479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.179294 Dec 08 11:34:55.081085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 275/550] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:54 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:55.235886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:55.236640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:55.243499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.243911 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.244686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.245119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.312518 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5710d313-391a-4374-bb88-e94d857ec3b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262954 Dec 08 11:34:55.313410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 276/551] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:34:55 2021] POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:55.379673 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1563396631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1810756953", "security_groups": [{"name": "tempest-secgroup-smoke-201663082"}], "networks": [{"uuid": "55a129bc-8ce3-4aac-98fb-64f16c4a4949"}], "block_device_mapping_v2": [{"uuid": "0bc9d904-0fec-49d9-8389-8f7f2a869a20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:55.408344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:55.417741 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:55.419306 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:55.420583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.188450 Dec 08 11:34:55.421211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 276/552] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:55 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:34:55.483347 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] validate_networks() for [('55a129bc-8ce3-4aac-98fb-64f16c4a4949', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:34:55.665865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:55.666983 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:55.672803 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.673360 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.674225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.676388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.704786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2fb16662-0d25-40f0-a37d-d30bfe3f4a1f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Dec 08 11:34:55.705364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 277/553] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:55 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:55.844556 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:34:55.845029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:34:55.845595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:34:55.846006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:34:55.846413 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:34:55.860227 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.860769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.861501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:55.861953 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:55.878471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Getting quotas for project 23027f58b51142389f64405702a0fcd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:34:55.882292 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Getting quotas for user abe3782a7d2e48cc922a46faf9c476d3 and project 23027f58b51142389f64405702a0fcd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:34:55.936149 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:34:55.938388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bc9d904-0fec-49d9-8389-8f7f2a869a20',volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:34:56.056685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.689997 Dec 08 11:34:56.057361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 277/554] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:34:55 2021] POST /compute/v2.1/servers => generated 405 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 08 11:34:56.067045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b7a90ddd-309e-4122-8cb8-850c422a69d2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:56.067653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b7a90ddd-309e-4122-8cb8-850c422a69d2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:56.097745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:56.098383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:56.107112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:56.107563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:56.108352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:56.108787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:56.129094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b7a90ddd-309e-4122-8cb8-850c422a69d2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:56.136018 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b7a90ddd-309e-4122-8cb8-850c422a69d2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1089 microversion: 2.1 time: 0.072524 Dec 08 11:34:56.136577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 278/555] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:56 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:56.253624 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:56.261951 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fcc3b908-4fe8-49e8-b71a-98978339adf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.168431 Dec 08 11:34:56.262514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 278/556] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:56 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:34:56.439218 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:56.439831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:56.445730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:56.446181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:56.446964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:56.447403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:56.578714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:56.587507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:56.589078 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:56.590326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-489dd35c-5a88-48b7-91b5-c4baaac5513e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.154813 Dec 08 11:34:56.590955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 279/557] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:56 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:56.715773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:56.716753 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:56.723208 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:56.723664 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:56.724449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:56.724891 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:56.753461 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4d757e71-8cf1-46c1-8b90-d58dc6ba47b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Dec 08 11:34:56.754007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 279/558] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:56 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:57.153237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:57.153770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:57.160737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.161204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.162065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.162528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.245820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:57.254021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a38d5370-59f6-4852-bf08-02f081988fe6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1195 microversion: 2.1 time: 0.104420 Dec 08 11:34:57.254740 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 280/559] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:57 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1195 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:57.279875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:57.281246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:57.287417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.287931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.288719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.289217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.514495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:57.523568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4aec7625-1ebf-4054-a820-756a2baedeba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.247316 Dec 08 11:34:57.524219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 280/560] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:57 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:57.609394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:57.610224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:57.616726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.617434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.618380 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.618971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.764295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:57.765611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:57.772152 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.772606 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.773426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:57.773870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:57.803266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8c8e2da7-5bb2-4335-94b7-7a5a76908a4b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Dec 08 11:34:57.803827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 281/561] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:57 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:57.832199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:57.839742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:57.841252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:57.842390 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d1da342c-35a4-4fdc-a9ad-f71627b16300 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.236912 Dec 08 11:34:57.842943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 281/562] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:57 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:58.271198 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:58.271734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:58.277562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.278014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.278791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.279225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.487929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:58.496872 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.229593 Dec 08 11:34:58.497797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 282/563] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:58 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:58.540202 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:58.540820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:58.557259 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.557811 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.558667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.559133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.759325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:58.767054 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9fdfc896-909a-4da3-aa72-8fd90913cf58 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.230494 Dec 08 11:34:58.767894 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 282/564] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:58 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:58.814618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:58.816324 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:58.823238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.823754 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.824769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.825357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.832743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:34:58.834287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:34:58.834287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:34:58.841452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.841906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.852943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d service nova] Creating event network-changed:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:34:58.858286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029701 Dec 08 11:34:58.858874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 283/565] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:34:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:58.862953 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-364ab571-1552-41f3-982b-e13dfa4cdce5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052067 Dec 08 11:34:58.863513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 283/566] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:58 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:34:58.865033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:58.865759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:58.872016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.872470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:58.873307 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:58.873755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.009523 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:59.017278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:59.019606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:59.020805 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8313af92-827e-4cb1-b0ad-063052f7005e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.160649 Dec 08 11:34:59.021398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 284/567] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:34:58 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:34:59.513755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:59.514355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:59.520407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:59.520854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.521724 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:59.522159 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.653098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:59.660744 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.150644 Dec 08 11:34:59.661330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 284/568] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:59 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:34:59.785833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:59.786379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:59.792529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:59.792979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.793802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:59.794241 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.874276 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:34:59.875205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:34:59.882060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:59.882515 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.883309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:34:59.883756 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:34:59.917389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e46b93e9-da9e-4720-870e-a7667fd3c61a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046894 Dec 08 11:34:59.917968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 285/569] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:34:59 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:34:59.929070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:34:59.936682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a310ee18-e330-406a-97b5-fe0eca64d176 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.154575 Dec 08 11:34:59.937255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 285/570] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:34:59 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:00.038660 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:00.039203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:00.044996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.045489 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.046275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.046717 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.176010 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:00.183703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:00.185241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:00.186396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-672d4f5a-48c2-426e-a5ca-10d5757c432a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.151540 Dec 08 11:35:00.186956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 286/571] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:00 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:00.676445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:00.677052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:00.682818 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.683267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.684031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.684461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.823807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:00.831062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-25d9c230-72cc-42e8-a63d-d1bddd971b8f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.158267 Dec 08 11:35:00.831629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 286/572] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:00 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:00.928294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:00.929234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:00.935570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.936030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.936819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.937297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.954372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:00.954974 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:00.960759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.961233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.962004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:00.962442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:00.966235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e052499f-6434-451b-99aa-ca5efed5a106 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Dec 08 11:35:00.966795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 287/573] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:00 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:01.120627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:01.135128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-eb781c30-6ed2-4aef-9379-53b5a4fceadb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.183969 Dec 08 11:35:01.135722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 287/574] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:00 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:01.204653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:01.205207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:01.211055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:01.211499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:01.212263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:01.212694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:01.337085 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:01.344722 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:01.346777 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:01.347946 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cc6d1530-9009-4895-8169-e42230feaac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.147030 Dec 08 11:35:01.348498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 288/575] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:01 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:01.847817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:01.848433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:01.854732 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:01.855191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:01.855974 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:01.856414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:01.977447 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:01.978388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:01.984473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:01.984626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:01.984925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:01.985739 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:01.986177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:01.991796 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dc657bfb-3d19-4841-81ca-f0d3e458f32f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.147904 Dec 08 11:35:01.992363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 288/576] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:01 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:02.014786 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a7378063-6d9a-4160-a5a7-be7dc6f013fb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041008 Dec 08 11:35:02.015321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 289/577] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:01 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:35:02.156773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:02.157912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:02.166912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:02.167373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:02.168169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:02.168616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:02.296119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:02.304296 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.152407 Dec 08 11:35:02.304861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 289/578] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:02 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:02.366228 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:02.366841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:02.372645 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:02.373102 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:02.373913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:02.374355 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:02.500294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:02.510950 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:02.512898 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:02.514084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3112a68a-099a-4d82-8a03-3998e4ee3639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.152037 Dec 08 11:35:02.514640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 290/579] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:02 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:03.008907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:03.009456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:03.015733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.016191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.016975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.017714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.026976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:03.028098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:03.034390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.034916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.035775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.036281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.066245 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fbc9f57f-15db-49bc-b4fa-29ad9f60b4b8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Dec 08 11:35:03.066938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 291/580] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:03 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:03.256460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:03.263951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b16380fe-185d-44d8-a5bc-9ef575459dae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.258670 Dec 08 11:35:03.264527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 290/581] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:03 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:03.321544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:03.322324 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:03.328101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.328548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.329362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.329813 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.470363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:03.477925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f86e9a85-d960-4e91-83b3-d4599041625d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.160036 Dec 08 11:35:03.478479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 292/582] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:03 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:03.531641 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:03.532156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:03.537930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.538376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.539138 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:03.539566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:03.665193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:03.672704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:03.674205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:03.675339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-573acd78-3696-4139-9589-e30a9a4eb729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.147471 Dec 08 11:35:03.675884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 291/583] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:03 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:04.077748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:04.078729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:04.085230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:04.086111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:04.086600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:04.087049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:04.116298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8c04adcd-e036-4edc-92eb-a13841e4187a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042246 Dec 08 11:35:04.116851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 293/584] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:04 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:35:04.263320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-896680821", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "6e4bda07-1ae1-4be4-bf28-e94211f51919"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:04.280305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:04.280914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:04.287495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:04.287945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:04.288724 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:04.289175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:04.315034 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] validate_networks() for [('6e4bda07-1ae1-4be4-bf28-e94211f51919', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:35:04.742424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:04.749547 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.472751 Dec 08 11:35:04.750138 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 294/585] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:04 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:04.754259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:04.755067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:04.760841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:04.761324 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:04.762111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:04.762544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:04.994134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:05.001857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.250783 Dec 08 11:35:05.002505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 295/586] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:04 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:05.015731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:05.016422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:05.022452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:05.022799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:35:05.023049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:05.023278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:35:05.023752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:35:05.024053 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:05.024162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:35:05.024582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:35:05.024690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:05.033477 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:05.034522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:05.035330 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:05.035765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:05.052833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:35:05.056994 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Getting quotas for user 3d93916bc3fd40fb8f60f9b7a592a29f and project 34e91fcdeaf64d10965b2770cbeab690. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:35:05.068892 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:35:05.071224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:35:05.118634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-377e9f61-b945-42b5-8ea1-850c28a2e443 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858902 Dec 08 11:35:05.123905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 292/587] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:35:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:35:05.129035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-91be3833-3539-404d-8aa8-66681a8a17e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:05.129675 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-91be3833-3539-404d-8aa8-66681a8a17e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:05.184411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:05.193815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:05.195857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:05.197537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-68dc5564-710b-47c2-93eb-4d99fa458b5d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.185054 Dec 08 11:35:05.198204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 296/588] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:05 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:05.199726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-91be3833-3539-404d-8aa8-66681a8a17e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:05.207673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-91be3833-3539-404d-8aa8-66681a8a17e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1217 microversion: 2.1 time: 0.082260 Dec 08 11:35:05.208380 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 293/589] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:05 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:05.766050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:05.766575 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:05.773263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:05.773729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:05.774497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:05.774927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:05.903782 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:05.911116 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.148764 Dec 08 11:35:05.911661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 297/590] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:05 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:06.019060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:06.019610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:06.026293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.026741 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.027508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.027971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.159299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:06.166967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-53b96499-9425-4ee1-84fb-bf778504b34e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.152010 Dec 08 11:35:06.167521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 294/591] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:06 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:06.215518 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:06.216131 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:06.222826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.223186 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:06.223295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.223797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:06.224044 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.224485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.229535 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.229987 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.231536 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.231989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.305454 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:06.312480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-532f4cb8-1042-4424-a7d4-7a83178949b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1221 microversion: 2.1 time: 0.092801 Dec 08 11:35:06.313038 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 295/592] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:06 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:06.372332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:06.380007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:06.381549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:06.382701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c343f114-e32e-4089-863b-6251e97fda44 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.170921 Dec 08 11:35:06.383258 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 298/593] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:06 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:06.927197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:06.927803 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:06.933438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.933886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:06.934656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:06.935086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.067519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:07.074884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-967aa6af-abc2-4d09-94df-d502589245ce tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.151142 Dec 08 11:35:07.075448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 296/594] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:06 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:07.183867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:07.184401 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:07.190306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:07.191274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.192057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:07.192500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.317596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:07.325239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.145116 Dec 08 11:35:07.325803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 299/595] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:07 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:07.329292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:07.329902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:07.336349 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:07.336800 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.337626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:07.338067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.395772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:07.400647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:07.401356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:07.402949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1a8f8913-968a-4a75-a568-aea4f931ee88 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1221 microversion: 2.1 time: 0.077217 Dec 08 11:35:07.403510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 297/596] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:07 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:07.407163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:07.407608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.408383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:07.408822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:07.541634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:07.549176 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:07.551203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:07.552372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a63de1c4-3dae-45fc-803a-fc9f25211309 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.155422 Dec 08 11:35:07.552920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 300/597] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:07 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:08.091521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:08.092127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:08.098871 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.099319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.100087 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.100517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.228776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:08.235955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.148019 Dec 08 11:35:08.236515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 298/598] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:08 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:08.342402 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:08.343041 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:08.349961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.350418 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.351206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.351647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.418854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:08.419485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:08.425144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.425620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.426384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.426824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.497485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:08.505236 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:08.505518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7edc86a8-81d0-4f37-a41c-d43b027bc29c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1213 microversion: 2.1 time: 0.090255 Dec 08 11:35:08.506115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 299/599] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:08 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:08.512969 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-54c4993e-b911-4593-965e-0ee8a7dd984a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.174161 Dec 08 11:35:08.513544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 301/600] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:08 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:08.570944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:08.571578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:08.577417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.577875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.578657 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:08.579098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:08.704741 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:08.712938 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:08.714478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:08.715628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9a3faaf6-5044-474b-ae2b-5e7908439a41 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.148276 Dec 08 11:35:08.716184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 300/601] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:08 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:09.254133 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:09.254778 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:09.260679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.261056 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.261870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.262309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.392969 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:09.400343 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5602496b-5c3e-4119-ad19-8757112549dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.151372 Dec 08 11:35:09.400907 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 302/602] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:09 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:09.522508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:09.523024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:09.529142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:09.529527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.529950 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:09.530062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.530731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.531160 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.536149 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.536694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.537517 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.537959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.596953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:09.604690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5a60cff2-bf38-4340-b610-0c5ed53fa385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1213 microversion: 2.1 time: 0.086329 Dec 08 11:35:09.605299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 301/603] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:09 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:09.691754 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:09.700059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-94c3df59-1840-4946-a873-75b8645977e6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1723 microversion: 2.1 time: 0.174504 Dec 08 11:35:09.700882 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 303/604] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:09 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:09.733527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:09.734144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:09.740594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.741053 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.741869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:09.742312 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:09.883090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:09.892184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:09.895083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:09.896670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-913e79bd-0801-4d4a-9931-a8d38c0bc820 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.166618 Dec 08 11:35:09.897433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 302/605] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:09 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:10.417573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:10.418198 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:10.424389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.425431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.426228 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.426676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.621801 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:10.623230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:10.630526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.631124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.631925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.632360 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.652843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:10.661104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5f1b3c58-5559-498f-b407-92bce997bb87 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.247216 Dec 08 11:35:10.662286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 304/606] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:10 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:10.708791 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:10.717818 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:10.722860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3e8d245c-d746-4769-b77b-834dd910b675 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1275 microversion: 2.1 time: 0.104790 Dec 08 11:35:10.732533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 303/607] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:10 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:10.732703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:10.732703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.732703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.732703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.733009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.915006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:10.915817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:10.921787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.922249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.923039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.923469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:10.948248 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:10.957362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1700 microversion: 2.1 time: 0.243074 Dec 08 11:35:10.957850 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 305/608] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:10 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1700 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:10.973273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8edb994d-e59c-418f-8b7a-bb0e29069374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:10.979140 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8edb994d-e59c-418f-8b7a-bb0e29069374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:10.979588 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8edb994d-e59c-418f-8b7a-bb0e29069374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:11.039046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8edb994d-e59c-418f-8b7a-bb0e29069374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Going to try to start instance {{(pid=117269) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 08 11:35:11.079972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8edb994d-e59c-418f-8b7a-bb0e29069374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 202 len: 0 microversion: 2.1 time: 0.110236 Dec 08 11:35:11.080748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 306/609] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:35:10 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:35:11.090155 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:11.090870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:11.098185 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:11.098643 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:11.100005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:11.100005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:11.211382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:11.223766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:11.225542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:11.226776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.316124 Dec 08 11:35:11.229205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 304/610] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:10 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:11.407304 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:11.416684 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.330818 Dec 08 11:35:11.417888 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 307/611] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:11 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:11.677918 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:11.678598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:11.684640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:11.685083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:11.685915 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:11.686344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:11.740164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:11.740805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:11.747168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:11.747555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:11.748340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:11.748776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:12.003714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:12.011143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-73002510-c452-4749-bea9-f1aa0ad92a85 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.337431 Dec 08 11:35:12.011829 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 305/612] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:11 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:12.051659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:12.059048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6691bd37-df18-4230-9771-30987c829f8f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.323114 Dec 08 11:35:12.059623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 308/613] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:11 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:12.245580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:12.246205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:12.252015 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:12.252407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:12.253313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:12.253757 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:12.412482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:12.414067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:12.414067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:12.420707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:12.421301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:12.431486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 service nova] Creating event network-changed:222531bb-d35b-49bb-b52a-9b0f529866e2 for instance 16a3dc0f-c35b-4f26-b4da-455158247814 on hv-cinder-81977 Dec 08 11:35:12.436639 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027704 Dec 08 11:35:12.437246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 309/614] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:12.442646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:12.443144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:12.448867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:12.449424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:12.450959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:12.451749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:12.461255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:12.469024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:12.470585 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:12.471807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7b38ae1b-b2f1-437b-831a-be847778222e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.230176 Dec 08 11:35:12.472358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 306/615] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:12 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:12.581780 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:12.593925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1629e93e-0961-4263-b55f-bdb1c894b007 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.155530 Dec 08 11:35:12.594521 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 310/616] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:12 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:13.028395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:13.029006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:13.035886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.036342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.037121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.037582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.075331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:13.076018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:13.082749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.083187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.084041 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.084479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.208461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:13.216226 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.191493 Dec 08 11:35:13.217072 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 307/617] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:13 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:13.250865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:13.258145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-11101ae8-78d2-4023-8421-6e625cf1f681 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.186364 Dec 08 11:35:13.258712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 311/618] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:13 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:13.489758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:13.490364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:13.496242 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.496700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.497515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.497957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.611351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:13.611888 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:13.618145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.618634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.619458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:13.619906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:13.627250 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:13.635613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:13.637179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:13.638341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.152312 Dec 08 11:35:13.638897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 308/619] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:13 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:13.748969 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:13.757274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ca92d739-2268-4764-b73c-ccac8b4cbe3e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.149610 Dec 08 11:35:13.758128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 312/620] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:13 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:14.234214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:14.234214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:14.240618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.241073 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.241883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.242326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.275160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:14.275908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:14.282128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.282587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.284686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.284686 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.398490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:14.406028 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-363dfdcf-a966-49af-ab40-705e1256b206 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.176090 Dec 08 11:35:14.406589 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 309/621] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:14 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:14.453525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:14.461087 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.189734 Dec 08 11:35:14.461667 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 313/622] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:14 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:14.656921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:14.657482 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:14.663347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.663797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.664574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.665008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.774772 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:14.775378 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:14.781430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.781889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.782677 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:14.783122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:14.794523 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:14.802285 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:14.803876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:14.805117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-06101e01-2070-48b0-b6e6-58584a0ac645 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.152379 Dec 08 11:35:14.805898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 310/623] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:14 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:14.909187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:14.916728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cf42699e-1eb9-4665-be33-721058eae5d0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.145756 Dec 08 11:35:14.917516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 314/624] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:14 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:15.422809 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:15.423420 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:15.430370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.430821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.431609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.432044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.477492 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:15.478110 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:15.484275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.484730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.485927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.486381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.617676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:15.625661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-76738d69-8fdb-4845-bad9-438387faf89a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.206460 Dec 08 11:35:15.626869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 311/625] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:15 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:15.647062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:15.654759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.180801 Dec 08 11:35:15.655360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 315/626] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:15 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:15.824029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:15.824633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:15.830763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.831208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.832270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.832706 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.934306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:15.935022 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:15.941858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.942301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.943073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:15.943506 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:15.963850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:15.971600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:15.973093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:15.974277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.154344 Dec 08 11:35:15.974835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 312/627] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:15 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:16.070336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:16.077910 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-06de6f46-0b5f-4bf1-94ce-527f93353441 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.147244 Dec 08 11:35:16.078466 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 316/628] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:15 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:16.643456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:16.644064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:16.650309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:16.650754 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:16.651521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:16.651979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:16.671148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:16.671757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:16.678478 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:16.678930 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:16.679711 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:16.680154 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:16.896742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:16.905484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-14549a9e-8010-41bc-8be2-f89d18346a8a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.265776 Dec 08 11:35:16.906357 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 313/629] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:16 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:16.934884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:16.943214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.275647 Dec 08 11:35:16.943776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 317/630] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:16 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:16.991669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:16.992537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:16.999075 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:16.999616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.000355 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.000935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.097546 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:17.098395 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:17.105121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.105836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.106870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.107706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.704026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:17.713282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:17.714794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:17.715980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dbe0e52b-84ae-4df8-a499-8bb420677efa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.728093 Dec 08 11:35:17.716538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 314/631] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:16 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:17.721125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:17.722390 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:17.728246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.728695 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.729580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.730016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.753414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lazy-loading 'flavor' on Instance uuid ef74eb6c-4764-40c3-8610-e4f4bc3e610d {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:35:17.834920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:17.843182 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2fe8cda6-91b4-4530-930b-40a3334f705e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.751888 Dec 08 11:35:17.843733 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 318/632] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:17 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:17.908146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c677ee78-f617-4a45-bf99-82dcf405e36a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action" status: 200 len: 32 microversion: 2.1 time: 0.189223 Dec 08 11:35:17.909560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 315/633] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:35:17 2021] POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:35:17.919836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:17.920939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:17.929265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.930098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.930682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:17.931449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.932041 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.932260 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:17.940882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.941673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:17.942722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:17.943165 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:18.541212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:18.549057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1272 microversion: 2.1 time: 0.624725 Dec 08 11:35:18.549971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 316/634] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:17 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1272 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:18.556661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:18.556923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:18.558517 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:18.565676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:18.566805 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:18.567239 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:18.567784 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:18.571612 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7748ebc9-410c-4e0c-a2bd-df9131a88dba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.656307 Dec 08 11:35:18.575560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 319/635] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:17 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:18.734063 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:18.734676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:18.741490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:18.742004 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:18.742812 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:18.743256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.078333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.086908 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a066a08d-eab7-4cf5-960c-cd2817146fdf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.535979 Dec 08 11:35:19.087889 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 317/636] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:18 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:19.094470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:19.095299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:19.102435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:19.102890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.103692 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:19.104135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.130587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.138523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.140043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.141278 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-09527e90-403e-4fc2-a8a4-84fbf71bc80b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1741 microversion: 2.20 time: 0.410986 Dec 08 11:35:19.141830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 320/637] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:18 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1741 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:19.294603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.302228 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c8799cb8-bf91-4317-bda3-6afe337f79d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1709 microversion: 2.1 time: 0.213217 Dec 08 11:35:19.302789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 318/638] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:19 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1709 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:19.566142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:19.566668 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:19.572375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:19.572823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.573634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:19.574069 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.590730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:19.591339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:19.597518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:19.597976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.598768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:19.599212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:19.777842 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.780925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:19.785465 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-98f0a890-b9ab-4472-ad89-156250adb460 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.223542 Dec 08 11:35:19.786116 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 321/639] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:19 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:19.788603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fc858685-e110-44e3-b428-e69af435af84 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.201515 Dec 08 11:35:19.789178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 319/640] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:19 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:20.103677 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:20.104384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:20.110264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.110718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.111507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.112613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.161092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:20.162469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:20.171313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.172833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.174136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.175459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.293179 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:20.301541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-11b259bb-15f9-42c2-a9ac-e75c88932c53 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.201513 Dec 08 11:35:20.302543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 322/641] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:20 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:20.319543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:20.320148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:20.326104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.326550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.327332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.327767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.361479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:20.369866 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:20.371371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:20.372538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-56db5fef-2d4f-4bf0-baec-604af78984e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1741 microversion: 2.20 time: 0.216688 Dec 08 11:35:20.373093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 320/642] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:20 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:20.463207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:20.471298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bca84f39-c59a-484f-bde7-427eb8207ad7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1713 microversion: 2.1 time: 0.156004 Dec 08 11:35:20.471860 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 323/643] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:20 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:20.803092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:20.804006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:20.805652 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:20.806259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:20.811141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.811141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.812093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.813452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.813776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.815581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:20.816166 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:20.817050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.007186 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:21.010331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:21.014525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.215676 Dec 08 11:35:21.015184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 321/644] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:20 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:21.019078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aedb735c-8b69-41d5-916b-6d85069af404 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.217047 Dec 08 11:35:21.019634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 324/645] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:20 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:21.318361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:21.318888 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:21.324683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:21.325213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.325987 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:21.326583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.391254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:21.391873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:21.398690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:21.399385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.400192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:21.400633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.486476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:21.493750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.179698 Dec 08 11:35:21.494322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 322/646] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:21 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:21.551668 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:21.559257 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:21.560760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:21.561947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1741 microversion: 2.20 time: 0.174487 Dec 08 11:35:21.562509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 325/647] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:21 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:21.822175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:21.822667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:21.828889 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:21.829368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.830145 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:21.830579 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:21.907283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lazy-loading 'services' on Instance uuid 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:35:21.974028 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-190e9df2-3672-4935-8dc6-d69f235e37ba tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9/os-volume_attachments/ed51d092-6543-4e59-a977-5df91a73d42b" status: 202 len: 0 microversion: 2.1 time: 0.155387 Dec 08 11:35:21.974602 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 323/648] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:35:21 2021] DELETE /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9/os-volume_attachments/ed51d092-6543-4e59-a977-5df91a73d42b => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:35:22.032731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:22.033366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:22.036335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:22.037098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:22.040487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.040939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.041966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.042426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.043276 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.043733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.044519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.044964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.488460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:22.493121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:22.496055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-64b13278-5406-48a4-b812-5fcf9bcd85bf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.464058 Dec 08 11:35:22.496621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 324/649] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:22 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:22.500640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-41155e89-b479-43bc-ad80-8a4a0091d959 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.472647 Dec 08 11:35:22.500865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-a52f0909-ad47-4a79-a47f-3794f8a356f5 req-b7ed7397-92c7-4859-8d24-cadd24d541c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:22.501376 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 326/650] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:22 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:22.502442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:22.502442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:35:22.509591 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a52f0909-ad47-4a79-a47f-3794f8a356f5 req-b7ed7397-92c7-4859-8d24-cadd24d541c7 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.510108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a52f0909-ad47-4a79-a47f-3794f8a356f5 req-b7ed7397-92c7-4859-8d24-cadd24d541c7 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.513732 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:22.514338 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:22.521119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.521594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.522294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-a52f0909-ad47-4a79-a47f-3794f8a356f5 req-b7ed7397-92c7-4859-8d24-cadd24d541c7 service nova] Creating event network-vif-plugged:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:35:22.522403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.522800 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.527156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-a52f0909-ad47-4a79-a47f-3794f8a356f5 req-b7ed7397-92c7-4859-8d24-cadd24d541c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029463 Dec 08 11:35:22.527725 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 325/651] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:22.580332 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:22.581613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:22.587559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.588004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.588775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:22.589227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:22.681936 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:22.689095 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.178881 Dec 08 11:35:22.689840 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 327/652] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:22 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:22.741569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:22.750331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:22.751833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:22.753439 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1741 microversion: 2.20 time: 0.176896 Dec 08 11:35:22.753994 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 326/653] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:22 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:23.511998 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:23.512660 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:23.518757 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:23.519391 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:23.519510 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.519876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.520663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.521096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.525831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.526278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.527049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.527485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.714762 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:23.719298 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:23.723263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-965549d7-68be-45b6-8426-a7970cd954ce tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.214804 Dec 08 11:35:23.723836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 328/654] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:23 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:23.728128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:23.728730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:23.734241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.734694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.735192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.220465 Dec 08 11:35:23.735473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.735753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 327/655] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:23 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:23.735970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.771288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:23.771886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:23.777712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.778162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.778939 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:23.779375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:23.901077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:23.908282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.183482 Dec 08 11:35:23.909418 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 329/656] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:23 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:23.944476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:23.952114 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:23.953626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:23.954758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d0c9e44e-3279-4f66-b3e8-07064c654a05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1741 microversion: 2.20 time: 0.187436 Dec 08 11:35:23.955310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 328/657] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:23 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:24.140500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:24.141070 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:24.147898 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.148361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.149246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.149772 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.180126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:35:24.256343 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9d882842-6d18-4826-ab29-58d6fec9fa82 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 204 len: 0 microversion: 2.1 time: 0.118975 Dec 08 11:35:24.257171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 330/658] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:35:24 2021] DELETE /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:35:24.265451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:24.266441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:24.273551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.274001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.274923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.275450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.408867 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:24.416956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-22e8a998-2f70-45ed-9662-c5d4182bdb03 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1514 microversion: 2.1 time: 0.155665 Dec 08 11:35:24.417560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 329/659] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:24 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:24.740574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:24.741315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:24.747812 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.748266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.749048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.749511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.751556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:24.752912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:24.762525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.762980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.763874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.764310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.956679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:24.960341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:24.964816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.228739 Dec 08 11:35:24.965420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 331/660] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:24 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:24.970071 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:24.971590 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:24.973757 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-85dfa18a-c670-4593-8974-ac14ae80aa24 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.225731 Dec 08 11:35:24.974526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 330/661] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:24 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:24.979130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.979286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:24.979581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.980373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.980703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:24.980981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.987945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.988387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:24.989233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:24.989666 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:25.183069 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:25.186120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:25.191422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:25.192929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:25.194109 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2b552820-72f2-46ca-b078-8df4ee74730a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1741 microversion: 2.20 time: 0.218489 Dec 08 11:35:25.194809 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 331/662] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:24 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:25.195828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.229177 Dec 08 11:35:25.196456 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 332/663] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:24 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:25.433251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:25.433859 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:25.440341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:25.440870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:25.441679 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:25.442114 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:25.571875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:25.579043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1514 microversion: 2.1 time: 0.149428 Dec 08 11:35:25.579610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 332/664] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:25 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:25.981541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:25.982156 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:25.988944 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:25.989434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:25.990222 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:25.990663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:25.991369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:25.992059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:25.998652 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:25.999216 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.004055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.005057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.198736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.208188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.230227 Dec 08 11:35:26.208775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 333/665] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:25 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:26.209460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.213539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:26.214326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:26.217410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.230478 Dec 08 11:35:26.220909 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.222086 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.223105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.223550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.227209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 333/666] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:25 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:26.231633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:26.232239 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:26.238137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.238444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.239225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.239661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.432468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.436030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.446577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9b7640d1-7032-4183-9259-ef211d1f5d7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.218314 Dec 08 11:35:26.447362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 334/667] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:26 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:26.447557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.449119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.450217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7e11c989-1f33-454e-b3cc-74531a579599 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.240514 Dec 08 11:35:26.450759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 334/668] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:26 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:26.598279 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:26.598925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:26.608649 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.609429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.611253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:26.612622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:26.759592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:26.769660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1514 microversion: 2.1 time: 0.176935 Dec 08 11:35:26.770456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 335/669] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:26 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:27.226793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:27.234394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:27.235582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:27.236132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:27.249089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.250845 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.251473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.253481 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.254475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.255439 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.256043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.259264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.569005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.581706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-09da79e1-2535-4e5c-8677-7ed8d5256505 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.358741 Dec 08 11:35:27.583224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 335/670] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:27 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:27.589383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:27.590195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:27.591673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.598089 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.598941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.599841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.600487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.606415 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9d1ac0c6-567f-408e-a550-a2f642343e73 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.371424 Dec 08 11:35:27.607626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 336/671] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:27 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:27.617071 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:27.622720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:27.637918 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.639213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.641364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.642724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.821824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.829529 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5f818682-d749-4144-9cc2-97622279ad6d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.245048 Dec 08 11:35:27.831257 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 336/672] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:27 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:27.836602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-68fd4d92-23ae-42eb-bddb-017fea82bd2f req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "name": "network-vif-deleted", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:27.838300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:27.838300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:27.846716 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-68fd4d92-23ae-42eb-bddb-017fea82bd2f req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.847187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-68fd4d92-23ae-42eb-bddb-017fea82bd2f req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.852302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.860678 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.863121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.864283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-35832010-b4c7-4a7b-a90b-4689d99509e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.255459 Dec 08 11:35:27.864826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 337/673] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:27 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:27.869364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:27.870144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:27.876555 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.877341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.878833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.879431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.881594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-68fd4d92-23ae-42eb-bddb-017fea82bd2f req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 service nova] Creating event network-vif-deleted:111e4836-2539-424a-86c3-da84a2a2dc76 for instance 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 on hv-cinder-81977 Dec 08 11:35:27.888819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-68fd4d92-23ae-42eb-bddb-017fea82bd2f req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056014 Dec 08 11:35:27.893581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 337/674] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:27.912854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:27.913613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:27.914214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lazy-loading 'fault' on Instance uuid 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:35:27.956412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:27.964059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2767138f-f82a-47a4-805f-41357e085a1f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 200 len: 1309 microversion: 2.1 time: 0.098077 Dec 08 11:35:27.965193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 338/675] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:27 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:28.510396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-a7954c27-ee44-4917-8c0d-74b38a7ec7db req-cbae5fa5-1849-49b0-8ee5-24b457fed75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "name": "network-vif-plugged", "status": "completed", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:28.517623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:28.517623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:28.536360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-a7954c27-ee44-4917-8c0d-74b38a7ec7db req-cbae5fa5-1849-49b0-8ee5-24b457fed75e service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.537054 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-a7954c27-ee44-4917-8c0d-74b38a7ec7db req-cbae5fa5-1849-49b0-8ee5-24b457fed75e service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.550410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-a7954c27-ee44-4917-8c0d-74b38a7ec7db req-cbae5fa5-1849-49b0-8ee5-24b457fed75e service nova] Creating event network-vif-plugged:222531bb-d35b-49bb-b52a-9b0f529866e2 for instance 16a3dc0f-c35b-4f26-b4da-455158247814 on hv-cinder-81977 Dec 08 11:35:28.558974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-a7954c27-ee44-4917-8c0d-74b38a7ec7db req-cbae5fa5-1849-49b0-8ee5-24b457fed75e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064337 Dec 08 11:35:28.559821 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 338/676] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:28.599329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:28.604163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:28.612199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.612825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.613872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.614293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.625543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:28.626247 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:28.638120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.643447 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.647749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.648410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.887917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:28.891676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:28.897896 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.302696 Dec 08 11:35:28.898579 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 339/677] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:28 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:28.902262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.280967 Dec 08 11:35:28.903031 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 339/678] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:28 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:28.903633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:28.904301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:28.908634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:28.909519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:28.915737 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.916417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.917457 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.918095 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.918220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.918559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:28.919425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:28.919870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:29.161657 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:29.175797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-06f02838-9496-4be5-90e6-3d00c329c7cf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.275843 Dec 08 11:35:29.178680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 340/679] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:28 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:29.179985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:29.188770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:29.189797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 9350ab5c-81eb-4a90-8a3b-266dc3794bb9] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:29.196742 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:29.198298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:29.199229 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:29.199487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2cf08acd-e45c-4822-a813-ebefba2d9390 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.294889 Dec 08 11:35:29.200042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:29.200185 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 340/680] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:28 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:29.201310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:29.201947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:29.228958 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] HTTP exception thrown: Instance 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 could not be found. Dec 08 11:35:29.229747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Returning 404 to user: Instance 9350ab5c-81eb-4a90-8a3b-266dc3794bb9 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:35:29.230998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-753b49f8-57cf-43b9-bc18-b129aabb35e0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9" status: 404 len: 111 microversion: 2.1 time: 0.051146 Dec 08 11:35:29.235197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 341/681] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:29 2021] GET /compute/v2.1/servers/9350ab5c-81eb-4a90-8a3b-266dc3794bb9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:35:29.914526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:29.915830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:29.922764 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:29.924048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:29.928922 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:29.929758 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:29.931155 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:29.931601 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:29.931886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:29.932338 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:29.933123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:29.933611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:30.177560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:30.187776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-be476233-a338-4221-8615-a73e6dd95180 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.276805 Dec 08 11:35:30.189340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:30.197074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 341/682] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:29 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:30.199282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0eecc981-4c07-43fe-a2df-88de195b01fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.280191 Dec 08 11:35:30.199999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 342/683] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:29 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:30.203057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:30.203849 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:30.213263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:30.214148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:30.214867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:30.215381 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:30.220426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:30.224059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:30.230673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:30.231133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:30.231916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:30.232525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:30.447290 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:30.457505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.257521 Dec 08 11:35:30.458472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 342/684] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:30 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:30.464395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:30.481330 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:30.484159 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:30.486200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.270120 Dec 08 11:35:30.496836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 343/685] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:30 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:31.205670 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:31.206351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:31.213002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.213499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.214300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.214755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.217875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:31.219003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:31.226227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.226687 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.227664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.227927 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.441808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:31.456603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ad5fbca9-3fce-4526-a412-34b5ede366ea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.254045 Dec 08 11:35:31.461356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 343/686] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:31 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:31.464709 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:31.472787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.258375 Dec 08 11:35:31.474047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 344/687] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:31 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:31.478497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:31.479105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:31.484992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.485537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.486250 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.486689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.507478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:31.508094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:31.515772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.516226 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.517016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:31.517745 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:31.726288 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:31.733735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.258586 Dec 08 11:35:31.743032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 344/688] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:31 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:31.761031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:31.769965 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:31.771553 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:31.772708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-188b9262-5b52-4261-9189-42b7d7a9b1c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.268877 Dec 08 11:35:31.773578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 345/689] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:31 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:32.476746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:32.478345 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:32.494664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:32.496104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:32.505462 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.506297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.508673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.509895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.510663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.511207 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.513941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.514494 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.742849 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:32.743196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:32.752273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-30b727fd-f74e-4031-bda3-244b162c3a06 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.263720 Dec 08 11:35:32.753665 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-24b3051a-4cb7-4310-973d-901ee6dfe4ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.283461 Dec 08 11:35:32.757469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 346/690] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:32 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:32.763163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 345/691] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:32 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:32.766073 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:32.766690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:32.773829 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.774285 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.775078 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.775517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.795698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:32.796502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:32.820955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.821940 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.823173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:32.823653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:32.969752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:32.979639 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f78084ed-20ed-40dc-b7d0-3f93651478d9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.219482 Dec 08 11:35:32.982913 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 347/692] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:32 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:33.014788 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:33.023635 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:33.025130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:33.026773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0a4e68e0-cf27-44ca-84f4-89932fa94139 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.238052 Dec 08 11:35:33.037691 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 346/693] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:32 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:33.770695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:33.771325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:33.772446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:33.773316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:33.780090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:33.780850 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:33.781896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:33.782593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:33.788952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:33.789568 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:33.790603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:33.791208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:34.024861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:34.028408 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:34.035592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.269771 Dec 08 11:35:34.063903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cf40f187-3b83-4417-87bd-72005695d3de tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.272102 Dec 08 11:35:34.063903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 347/694] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:33 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:34.063903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:34.063903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:34.063903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:34.064449 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 348/695] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:33 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:34.064552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:34.064552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:34.064552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:34.064811 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:34.064811 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:34.069254 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:34.069718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:34.070532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:34.070976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:34.289710 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:34.301166 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:34.301821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:34.303517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:34.304948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4fe12add-09b2-4583-900e-420a5c68b367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.246945 Dec 08 11:35:34.307190 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 349/696] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:34 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:34.311257 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-442968d3-a484-474d-8a28-38d4a04018cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.270257 Dec 08 11:35:34.312051 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 348/697] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:34 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:35.062566 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:35.063203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:35.069270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:35.069885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:35.077009 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.077485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.078277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.078715 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.083553 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.084105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.090626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.091084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.305460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:35.308742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:35.318605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-89014512-a7b6-4714-89ed-12365a9fe2ee tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1567 microversion: 2.1 time: 0.262127 Dec 08 11:35:35.321048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-384f1f71-3405-4541-b298-522cee59a78f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.261219 Dec 08 11:35:35.328237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 350/698] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:35 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:35.332853 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:35.333622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:35.334139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 349/699] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:35 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:35.339659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.340129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.340934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.341455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.343211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:35.344168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:35.350671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.351114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.351917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:35.352352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:35.567053 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:35.573995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:35.584215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:35.585736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1317 microversion: 2.1 time: 0.255664 Dec 08 11:35:35.589925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:35.593386 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-77ed6d9b-c031-41b3-bac8-55bae45106c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.258120 Dec 08 11:35:35.594215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 350/700] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:35 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:35.595023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 351/701] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:35 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:36.336266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:36.336841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:36.346843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:36.347451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.347853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.348636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:36.350039 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.351617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.357590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.360041 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.361652 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.366136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.670694 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:36.671983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:36.683137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.340713 Dec 08 11:35:36.683763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-efef80bb-1a82-41d3-8f24-bd558418a68b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1547 microversion: 2.1 time: 0.351151 Dec 08 11:35:36.684748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 351/702] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:36 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1547 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:36.689626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-e2ef6b79-1729-4da2-8ce4-34559cfbaf73 req-8f9216f1-179e-4403-a49f-619bcc103069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:36.692059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:36.692059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:36.697855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 352/703] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:36 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:36.699268 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e2ef6b79-1729-4da2-8ce4-34559cfbaf73 req-8f9216f1-179e-4403-a49f-619bcc103069 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.700685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e2ef6b79-1729-4da2-8ce4-34559cfbaf73 req-8f9216f1-179e-4403-a49f-619bcc103069 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.709975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:36.710864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:36.714900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-e2ef6b79-1729-4da2-8ce4-34559cfbaf73 req-8f9216f1-179e-4403-a49f-619bcc103069 service nova] Creating event network-vif-plugged:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:35:36.717877 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.718342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.719526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.719968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.721397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-e2ef6b79-1729-4da2-8ce4-34559cfbaf73 req-8f9216f1-179e-4403-a49f-619bcc103069 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Dec 08 11:35:36.722546 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 352/704] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:36.730323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:36.744765 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:36.768394 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.768920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.769818 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.770327 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.912835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:36.923539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1505 microversion: 2.1 time: 0.224259 Dec 08 11:35:36.924964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 353/705] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:36 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:36.931250 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:36.932093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:36.946812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.946812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:36.947412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:36.947858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.050929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:37.062373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:37.065537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:37.081125 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ac19253a-ec39-49bc-a1d2-a0c61320c1af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.344710 Dec 08 11:35:37.086035 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 353/706] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:36 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:37.184617 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] HTTP exception thrown: Cannot 'detach_volume' instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d while it is in vm_state rescued Dec 08 11:35:37.185365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Returning 409 to user: Cannot 'detach_volume' instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d while it is in vm_state rescued {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:35:37.186244 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e49b199c-caa5-46c6-920a-3d58893e5ca0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments/5037143f-89a3-48fa-89eb-c80ecf0c3639" status: 409 len: 152 microversion: 2.1 time: 0.259421 Dec 08 11:35:37.186917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 354/707] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:35:36 2021] DELETE /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments/5037143f-89a3-48fa-89eb-c80ecf0c3639 => generated 152 bytes in 261 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 08 11:35:37.195521 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:37.196255 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:37.202747 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:37.203197 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.204154 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:37.204788 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.277713 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action" status: 202 len: 0 microversion: 2.1 time: 0.085544 Dec 08 11:35:37.281569 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 354/708] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:35:37 2021] POST /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:35:37.287001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:37.287714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:37.293702 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:37.294154 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.294955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:37.295372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.432062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:37.439824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b98aa19d-392f-4d1f-aa7f-d170c878b99f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.156995 Dec 08 11:35:37.440537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 355/709] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:37 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:37.712885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:37.713528 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:37.719469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:37.719918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.720687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:37.721122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:37.849234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:37.856333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f4af3162-8ce6-4497-99ef-823e2be126f7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.147916 Dec 08 11:35:37.856897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 355/710] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:37 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:38.100633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:38.101368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:38.107023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:38.107475 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:38.108254 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:38.108683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:38.266497 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:38.274947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:38.276437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:38.277614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-14238dd6-5f72-4d60-a672-0ac0c32bec69 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.180619 Dec 08 11:35:38.278166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 356/711] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:38 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:38.456065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:38.456676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:38.462611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:38.463050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:38.463835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:38.464277 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:38.589256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:38.597424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-eed7d9ef-45b5-4c58-960a-241c130481ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.144953 Dec 08 11:35:38.597984 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 356/712] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:38 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:38.872619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:38.873257 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:38.880006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:38.880461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:38.881279 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:38.881725 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:39.238284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:39.245504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-95a90036-b9e6-4e5c-ac79-5233229e11bc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.376461 Dec 08 11:35:39.246060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 357/713] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:38 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:39.295239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:39.295845 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:39.302710 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:39.303159 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:39.303932 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:39.304368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:39.432403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:39.439946 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:39.441535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:39.442830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9563a2f5-4570-46e9-9a49-315060af12a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.151139 Dec 08 11:35:39.443526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 357/714] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:39 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:39.616227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:39.616839 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:39.622684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:39.623145 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:39.624080 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:39.624522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:39.760503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:39.769064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.158146 Dec 08 11:35:39.769663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 358/715] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:39 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:40.263803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:40.264414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:40.271298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:40.271752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:40.272540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:40.272979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:40.405810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:40.412913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cb2ada73-7049-4f60-927b-cd67c17611c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.154106 Dec 08 11:35:40.413493 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 358/716] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:40 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:40.460712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:40.461383 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:40.467783 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:40.468233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:40.469008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:40.469475 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:40.595445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:40.602952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:40.604366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:40.605533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-795c249b-0b81-4c46-ad2a-4de142b04df8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.148479 Dec 08 11:35:40.606074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 359/717] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:40 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:40.785725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:40.786328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:40.792159 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:40.792607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:40.793410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:40.793872 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:40.920836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:40.929061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-82717343-e14e-4df3-afce-fda5f9cf0645 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.147523 Dec 08 11:35:40.929726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 359/718] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:40 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:41.428284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:41.428894 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:41.434804 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:41.435336 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:41.436219 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:41.436673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:41.567200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:41.574436 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.149793 Dec 08 11:35:41.574989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 360/719] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:41 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:41.623714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:41.624319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:41.630979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:41.631425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:41.632194 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:41.632626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:41.758995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:41.766634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:41.768983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:41.770156 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.150117 Dec 08 11:35:41.770733 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 360/720] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:41 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:41.945858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:41.946465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:41.952277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:41.952726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:41.953530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:41.954003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:42.083514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:42.091363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3d979bb8-2570-466d-850a-abeaac11deb2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.149089 Dec 08 11:35:42.091921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 361/721] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:41 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:42.591410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:42.592017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:42.597839 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:42.598295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:42.599065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:42.599500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:42.727090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:42.734150 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.146501 Dec 08 11:35:42.734702 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 361/722] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:42 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:42.788304 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:42.788960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:42.795252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:42.795697 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:42.796468 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:42.796899 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:42.923222 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:42.931328 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:42.932805 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:42.933966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d929d5e5-680b-480a-b78d-b1f40a224377 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1736 microversion: 2.20 time: 0.149771 Dec 08 11:35:42.934509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 362/723] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:42 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:43.108900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:43.109534 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:43.115906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:43.116351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:43.117128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:43.117582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:43.246505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:43.254239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.148942 Dec 08 11:35:43.254795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 362/724] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:43 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:43.445936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1422419477", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "networks": [{"uuid": "a19166f1-a36a-4f08-8a61-f4d3fa1e8383"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:43.495479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] validate_networks() for [('a19166f1-a36a-4f08-8a61-f4d3fa1e8383', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:35:43.545510 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71eb479-89b4-400a-a3ce-d02ff753430e"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:43.546783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:43.552985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:43.553542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:43.554396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:43.554894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:43.828262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a1925cdc-2487-4cb4-8e33-2851f271ecbc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "POST /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287701 Dec 08 11:35:43.828939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 363/725] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:35:43 2021] POST /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:35:43.835422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:43.836126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:43.844308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:43.845863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:43.845863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:43.846160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.077901 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:35:44.078394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:35:44.078995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:35:44.079541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:35:44.079962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:35:44.089961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:44.090415 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.091237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:44.091677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.108110 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Getting quotas for project b1b41ae149164acbb31b021c9049b500. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:35:44.112027 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Getting quotas for user 97f278a968674782b818bb4e83572402 and project b1b41ae149164acbb31b021c9049b500. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:35:44.123014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:35:44.125342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:35:44.129606 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:44.137022 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-081fde80-e026-4f4f-b52a-990bcdb5e963 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1260 microversion: 2.1 time: 0.307009 Dec 08 11:35:44.137868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 364/726] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:43 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1260 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:44.143879 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:44.146154 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:44.151550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:44.152001 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.152863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:44.153414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.181143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738855 Dec 08 11:35:44.181990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 363/727] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:35:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:35:44.192642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-14710c50-eebd-4e14-a160-dda941ff5f21 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:44.193366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-14710c50-eebd-4e14-a160-dda941ff5f21 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:44.292080 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-14710c50-eebd-4e14-a160-dda941ff5f21 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:44.299613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-14710c50-eebd-4e14-a160-dda941ff5f21 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1219 microversion: 2.1 time: 0.110852 Dec 08 11:35:44.300192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 364/728] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:44 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:44.305648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:44.306618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:44.318604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:44.319153 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.319857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:44.320480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:44.463848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:44.472587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:44.474087 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:44.475586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-52c19c23-91cc-4e64-a4fd-04b64cedf747 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1718 microversion: 2.20 time: 0.336991 Dec 08 11:35:44.476144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 365/729] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:44 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1718 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:44.567362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:44.576737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.275335 Dec 08 11:35:44.577602 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 365/730] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:44 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:45.153407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:45.153961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:45.160868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.161360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.162143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.162583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.304921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.312402 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ec024138-8abe-4785-a51d-e0e8a57fa465 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1444 microversion: 2.1 time: 0.162474 Dec 08 11:35:45.313047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 366/731] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:45 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:45.319948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:45.321177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:45.328543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.329299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.330321 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.331364 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:45.331742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.331975 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:45.337931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.338622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.339580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.340173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.415400 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.423600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-54a5b580-99e9-4126-acf0-2e48b94fdaab tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1279 microversion: 2.1 time: 0.107124 Dec 08 11:35:45.424289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 366/732] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:45 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:45.494733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:45.495339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:45.501018 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.501498 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.502810 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.503420 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.616107 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.623317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5322ad00-f08a-4cd6-a99c-fef8632c6516 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1444 microversion: 2.1 time: 0.296152 Dec 08 11:35:45.623899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 367/733] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:45 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1444 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:45.628701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:45.629333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:45.635517 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.635741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.636544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:45.636992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:45.751883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.760550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.762048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.763248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ed2a11f0-9753-4c60-bc63-c1c843f98204 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1718 microversion: 2.20 time: 0.272138 Dec 08 11:35:45.774634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 367/734] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:45 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1718 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:45.905582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:45.913692 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-eb60cb17-b7b0-49f0-8052-92707b66387f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.288747 Dec 08 11:35:45.914406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 368/735] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:45 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:46.441786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:46.442583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:46.451064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.451743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:46.453230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.453829 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:46.493387 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-7b283391-0062-465a-ac1d-fd15b97b220b req-34b8a949-893a-406d-b5eb-efed8505afaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:46.495791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:46.495791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:46.505815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-7b283391-0062-465a-ac1d-fd15b97b220b req-34b8a949-893a-406d-b5eb-efed8505afaa service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.506535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-7b283391-0062-465a-ac1d-fd15b97b220b req-34b8a949-893a-406d-b5eb-efed8505afaa service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:46.518189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-7b283391-0062-465a-ac1d-fd15b97b220b req-34b8a949-893a-406d-b5eb-efed8505afaa service nova] Creating event network-vif-unplugged:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:35:46.523793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-7b283391-0062-465a-ac1d-fd15b97b220b req-34b8a949-893a-406d-b5eb-efed8505afaa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034171 Dec 08 11:35:46.524609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 369/736] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:35:46.711102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:46.718426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e66e8bc2-02d9-4321-a647-560ddbfffc0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.280989 Dec 08 11:35:46.719060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 368/737] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:46 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:46.782074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:46.782913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:46.789611 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.790286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:46.791075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.791687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:46.931480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:46.933334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:46.941333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.941919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:46.943007 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:46.943874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:47.080677 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:47.097777 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:47.099508 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:47.100900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-00a96e00-8749-494d-b90b-b9ca64db9ef2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1718 microversion: 2.20 time: 0.323272 Dec 08 11:35:47.104152 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 370/738] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:46 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1718 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:47.247860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:47.261451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-64dc5f51-ec19-43d2-b760-f2f0af453721 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1555 microversion: 2.1 time: 0.333747 Dec 08 11:35:47.262413 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 369/739] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:46 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1555 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:47.277810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:47.279076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:47.279076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:47.292181 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:47.297726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:47.318047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 service nova] Creating event network-changed:a6ac8770-1fec-45c1-8b57-a96317ee73ed for instance 87e72067-7d43-45ee-9f67-e4a72419ea29 on hv-cinder-81977 Dec 08 11:35:47.322744 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048620 Dec 08 11:35:47.323544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 371/740] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:35:47.736835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:47.739045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:47.748359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:47.749093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:47.750233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:47.751226 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:47.767815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-5b365461-3315-4625-898a-83d50ee1a280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:47.769912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:47.769912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:47.782953 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-5b365461-3315-4625-898a-83d50ee1a280 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:47.783448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-5b365461-3315-4625-898a-83d50ee1a280 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:47.797902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-5b365461-3315-4625-898a-83d50ee1a280 service nova] Creating event network-changed:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:35:47.805736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-5b365461-3315-4625-898a-83d50ee1a280 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043002 Dec 08 11:35:47.806432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 372/741] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:48.134727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:48.135458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:48.144091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.144551 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.145390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.145835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.365647 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:48.373665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.641733 Dec 08 11:35:48.374658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 370/742] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:47 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:48.379368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:48.379982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:48.385847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.386789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.387763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.388379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.602468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:48.610443 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:48.612673 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:48.613967 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6352b75c-8cbf-4307-9544-36e97a31e8b4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1661 microversion: 2.20 time: 0.483249 Dec 08 11:35:48.614547 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 373/743] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:48 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1661 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:48.631427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77427cad-21cb-4528-bf76-3b754f6ef115"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:48.632494 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:48.638706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.639193 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.639999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.640441 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.781124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:48.790613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1561 microversion: 2.1 time: 0.414516 Dec 08 11:35:48.802876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 371/744] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:48 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1561 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:48.865311 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:48.865836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:48.871802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.872343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.873253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:48.873762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:48.973443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lazy-loading 'services' on Instance uuid ef74eb6c-4764-40c3-8610-e4f4bc3e610d {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:35:49.006919 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4db4c295-9f83-4877-80d7-bc6c7c5b62a0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.379415 Dec 08 11:35:49.007827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 374/745] 10.222.0.66 () {62 vars in 1363 bytes} [Wed Dec 8 11:35:48 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments => generated 188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:35:49.050271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c262c97b-2518-4d8c-9729-40fa7bcd394d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments/5037143f-89a3-48fa-89eb-c80ecf0c3639" status: 202 len: 0 microversion: 2.1 time: 0.188676 Dec 08 11:35:49.050868 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 372/746] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:35:48 2021] DELETE /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments/5037143f-89a3-48fa-89eb-c80ecf0c3639 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:35:49.068254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:49.068254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:49.068254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.075325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.076726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.077204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.123114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4d6135ea-93f9-44f4-afec-8b9db93412a1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067648 Dec 08 11:35:49.123683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 375/747] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:49 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:49.137023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:49.138023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:49.145292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.145834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.146744 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.147215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.251830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action" status: 202 len: 0 microversion: 2.20 time: 0.118791 Dec 08 11:35:49.252959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 373/748] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:35:49 2021] POST /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 08 11:35:49.260567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:49.261195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:49.267234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.268283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.269047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.269545 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.391088 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:49.392544 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:49.400130 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.400247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.401023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:49.401485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:49.403446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:49.413081 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:49.416253 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:49.417830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b728f510-886a-4343-adf8-ab7814bbc50c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1747 microversion: 2.20 time: 0.160529 Dec 08 11:35:49.418489 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 376/749] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:49 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:49.540201 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:49.547584 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.160195 Dec 08 11:35:49.548224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 374/750] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:49 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:50.135495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:50.136451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:50.142994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:50.143454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:50.145042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:50.145944 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:50.186523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f7e14094-5552-455c-82fe-f690e47f36ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054782 Dec 08 11:35:50.187084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 377/751] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:50 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:50.435445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:50.436046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:50.442047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:50.442492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:50.443301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:50.443730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:50.565382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:50.566112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:50.571343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:50.572323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:50.572849 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:50.573749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:50.574259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:50.579341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:50.581430 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:50.582560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-22d0181a-4700-4ee0-9b21-c978022ad57a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1749 microversion: 2.20 time: 0.150786 Dec 08 11:35:50.583106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 375/752] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:50 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:50.708854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:50.716245 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.155071 Dec 08 11:35:50.716818 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 378/753] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:50 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:51.197416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:51.198436 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:51.204229 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:51.204673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:51.206001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:51.206431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:51.234622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2d0e1e90-985e-4d7f-b091-ac6f4c0fa1b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Dec 08 11:35:51.235156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 376/754] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:51 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:51.600749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:51.601393 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:51.607705 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:51.608161 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:51.608949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:51.609423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:51.732826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:51.733367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:51.738404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:51.742390 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:51.742838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:51.743621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:51.744111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:51.746613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:51.748106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:51.749299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8e52932f-320a-41d0-8b3d-bd6d90971e01 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1749 microversion: 2.20 time: 0.152384 Dec 08 11:35:51.749861 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 379/755] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:51 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:51.878104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:51.885294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-73922f64-8a0c-4747-b566-df26ec6ab3db tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.156114 Dec 08 11:35:51.885855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 377/756] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:51 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:52.245745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:52.246747 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:52.252460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.252912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.253733 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.254177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.285752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3a1f2e4e-9d5e-4cba-accc-ba40c06cac32 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Dec 08 11:35:52.286301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 380/757] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:52 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:52.557552 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:52.558298 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:52.567217 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.568178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.569324 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.569998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.653099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'services' on Instance uuid 16a3dc0f-c35b-4f26-b4da-455158247814 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:35:52.727303 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-869843f8-e7ef-4193-a35a-fa80f2a68cd3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments/d71eb479-89b4-400a-a3ce-d02ff753430e" status: 202 len: 0 microversion: 2.1 time: 0.176716 Dec 08 11:35:52.728283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 378/758] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:35:52 2021] DELETE /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments/d71eb479-89b4-400a-a3ce-d02ff753430e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:35:52.737263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:52.738181 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:52.744898 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.745400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.746171 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.746706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.769081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:52.769823 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:52.776339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.776799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.777617 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.778060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.779843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3408bd43-d1ba-414e-8d2d-9d4122563033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Dec 08 11:35:52.780400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 381/759] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:52 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:52.901507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:52.902230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:52.908092 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.908649 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.909567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:52.910077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:52.912198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:52.920461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:52.922025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:52.923180 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9cb53db7-3d59-4df1-bedc-716271d3e488 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1749 microversion: 2.20 time: 0.159060 Dec 08 11:35:52.923912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 379/760] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:52 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:35:53.043173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:53.050972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.153003 Dec 08 11:35:53.051548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 382/761] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:52 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:53.297431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:53.298458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:53.305120 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:53.305828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:53.306630 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:53.307072 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:53.335934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fd8d7881-eb30-49d6-930f-dbd75dcaafd1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042329 Dec 08 11:35:53.336495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 380/762] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:53 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:35:53.792075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:53.792894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:53.799857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:53.800305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:53.801084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:53.801545 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:53.829118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-003a1db0-21ae-46f8-9308-a25728c37b2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040972 Dec 08 11:35:53.829684 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 383/763] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:53 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:53.941310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:53.941910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:53.948346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:53.948792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:53.949615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:53.950049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:54.068141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:54.068676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:54.074622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:54.075073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:54.075965 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:54.076399 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:54.216612 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:54.228134 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:54.229609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:54.230787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.293311 Dec 08 11:35:54.231340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 381/764] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:53 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:54.322977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:54.330791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c7bc1821-67f9-4b1f-af28-4df0a618c093 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.265980 Dec 08 11:35:54.331545 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 384/765] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:54 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:54.840727 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:54.841638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:54.848378 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:54.849335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:54.850131 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:54.850575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:54.881274 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-987b7964-9c41-4bcd-8e58-5f06d93a6c80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044866 Dec 08 11:35:54.881866 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 382/766] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:35:54 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:35:55.250174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:55.251970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:55.262852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.263377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.264199 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.264683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.348265 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:55.348787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:55.355001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.355458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.356250 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.356696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.445719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:55.461734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:55.471896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:55.474725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.229843 Dec 08 11:35:55.475289 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 385/767] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:55 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:55.528980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:55.536947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1ed0729a-166c-4421-9675-0668a30e5671 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.193012 Dec 08 11:35:55.537547 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 383/768] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:55 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:55.651580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:55.652091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:55.657900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.659005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.659794 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.660238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.684484 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:35:55.761648 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 204 len: 0 microversion: 2.1 time: 0.113543 Dec 08 11:35:55.762436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 386/769] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:35:55 2021] DELETE /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:35:55.770826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:55.771438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:55.777573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.778025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.778805 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:55.779246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:55.912108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:55.919716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-89c14e3e-521d-4279-b480-0e43ba2cc369 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.153280 Dec 08 11:35:55.920376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 384/770] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:55 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:56.076518 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:56.077113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:56.083596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.084051 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.084838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.085309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.109238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:35:56.180212 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 204 len: 0 microversion: 2.1 time: 0.107355 Dec 08 11:35:56.180712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 387/771] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:35:56 2021] DELETE /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:35:56.188328 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:56.188935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:56.195349 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.195799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.196577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.197013 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.325429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:56.333843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.148973 Dec 08 11:35:56.334568 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 385/772] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:56 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:56.492511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:56.493797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:56.500291 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.500749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.501600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.502605 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.554110 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:56.554733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:56.561182 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.561851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.562651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.563088 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.711543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:56.720145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:56.722202 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:56.723362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c7fe4295-3441-4b57-9e68-2dfcb391af16 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.234824 Dec 08 11:35:56.723918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 388/773] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:56 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:56.733970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-f0b31c98-661e-4573-9fcf-2f20a6d2706a req-f49ca51d-a54f-4dae-8765-86f41c157068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "name": "network-vif-plugged", "status": "completed", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:35:56.735774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:35:56.735774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:35:56.743715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-f0b31c98-661e-4573-9fcf-2f20a6d2706a req-f49ca51d-a54f-4dae-8765-86f41c157068 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.744158 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-f0b31c98-661e-4573-9fcf-2f20a6d2706a req-f49ca51d-a54f-4dae-8765-86f41c157068 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.754888 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-f0b31c98-661e-4573-9fcf-2f20a6d2706a req-f49ca51d-a54f-4dae-8765-86f41c157068 service nova] Creating event network-vif-plugged:a6ac8770-1fec-45c1-8b57-a96317ee73ed for instance 87e72067-7d43-45ee-9f67-e4a72419ea29 on hv-cinder-81977 Dec 08 11:35:56.759824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-f0b31c98-661e-4573-9fcf-2f20a6d2706a req-f49ca51d-a54f-4dae-8765-86f41c157068 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Dec 08 11:35:56.760693 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 389/774] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:35:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:35:56.779637 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:56.787202 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.236708 Dec 08 11:35:56.787753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 386/775] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:56 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:56.936877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:56.937633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:56.943794 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.944252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:56.945038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:56.945644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.084846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:57.092335 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.159415 Dec 08 11:35:57.092918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 390/776] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:56 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:57.350563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:57.351167 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:57.357177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:57.357631 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.358416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:57.358855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.503082 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:57.510331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.163401 Dec 08 11:35:57.510894 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 387/777] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:57 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:57.742630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:57.743169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:57.750239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:57.750700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.751499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:57.752554 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.804460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:57.805359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:57.815048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:57.822946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.824874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:57.825929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:57.931644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:57.940593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:57.942200 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:57.943439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.205150 Dec 08 11:35:57.944106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 391/778] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:57 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:57.989245 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:57.997310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d757dbb7-09db-4808-a762-5ba6872beef3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.196782 Dec 08 11:35:58.007696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 388/779] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:57 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:58.109527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:58.110144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:58.116862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:58.117356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:58.118150 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:58.118595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:58.257397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:58.265075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.159142 Dec 08 11:35:58.265704 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 392/780] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:58 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:58.528008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:58.528522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:58.539489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:58.539952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:58.541832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:58.542545 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:58.680308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:58.687526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.163205 Dec 08 11:35:58.688156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 389/781] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:58 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:58.961962 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:58.962574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:58.968907 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:58.969392 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:58.970182 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:58.970622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.014291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:59.014994 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:59.022010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:59.022451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.023225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:59.023658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.145338 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:59.153951 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:59.155471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:59.156846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-666a86a1-2224-4fc5-901f-5a3f7836346f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.198639 Dec 08 11:35:59.157431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 393/782] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:35:58 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:35:59.187400 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:59.194959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.184314 Dec 08 11:35:59.195514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 390/783] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:59 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:35:59.282287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:59.282896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:59.288779 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:59.289259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.290054 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:59.290493 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.418866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:59.426994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fff13d37-015b-4f76-ace4-451d38c776a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.148334 Dec 08 11:35:59.427560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 394/784] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:59 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:35:59.703600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:35:59.704129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:35:59.710602 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:59.711049 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.711861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:35:59.712296 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:35:59.847770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:35:59.855012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.155157 Dec 08 11:35:59.855577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 391/785] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:35:59 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:00.175766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:00.176377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:00.182670 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.183119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.183897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.184341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.211212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:00.211822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:00.224012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.224472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.225501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.226125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.353912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:00.363352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:00.365038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:00.366344 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cfea236f-ee47-4d9a-87f9-d612a39154ec tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.194888 Dec 08 11:36:00.366988 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 395/786] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:00 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:00.400940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:00.408534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3ae7ad91-396d-41b3-9487-a7521e04625a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.200335 Dec 08 11:36:00.409085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 392/787] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:00 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:00.443430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:00.444048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:00.449855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.450316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.451108 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.451550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.592083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:00.600144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.160281 Dec 08 11:36:00.600646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 396/788] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:00 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:00.871789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:00.872381 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:00.879051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.879507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:00.880291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:00.880733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.017690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:01.024800 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ebccdf62-b13f-4524-b94c-ba76e709897f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.156797 Dec 08 11:36:01.025392 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 393/789] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:00 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:01.383420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:01.384036 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:01.390249 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:01.390699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.391480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:01.392176 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.425571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:01.426173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:01.432486 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:01.432933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.433737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:01.434168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.799119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:01.807548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:01.809045 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:01.810230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1a2ec873-6d3d-41db-9303-99d648c42127 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.430463 Dec 08 11:36:01.810797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 397/790] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:01 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:01.815525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:01.816128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:01.821880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:01.822332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.823130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:01.823570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:01.842540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:01.849682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fc3e9557-6707-4c86-9929-3b6a21b63b08 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.428304 Dec 08 11:36:01.850237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 394/791] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:01 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:01.955383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:01.962540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.150820 Dec 08 11:36:01.963100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 398/792] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:01 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:02.042029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:02.042676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:02.048574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:02.049026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:02.049834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:02.050272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:02.193980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:02.201133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7c887852-40ae-495c-8f01-b44fb1e77aba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.162805 Dec 08 11:36:02.201718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 395/793] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:02 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:02.829778 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:02.830382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:02.836512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:02.836961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:02.837769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:02.838206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:02.866711 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:02.867315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:02.873495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:02.873941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:02.874713 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:02.875149 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:03.020495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:03.029985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:03.031505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:03.032672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a620cf4c-6f89-4d35-9676-d59cb8e2601e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.206601 Dec 08 11:36:03.034265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 399/794] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:02 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:03.038480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:03.039084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:03.044917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:03.045417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:03.046196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:03.046640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:03.052359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:03.060818 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fbb9f283-235b-4fba-914a-202d5b68929c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.197032 Dec 08 11:36:03.072560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 396/795] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:02 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:03.198340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:03.206155 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-86189ad5-1d54-4055-a367-2f569b3e60ef tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.170937 Dec 08 11:36:03.206721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 400/796] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:03 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:03.216954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:03.218101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:03.224778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:03.225279 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:03.226076 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:03.226520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:03.361691 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:03.369093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.155726 Dec 08 11:36:03.369685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 397/797] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:03 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:04.051817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:04.052426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:04.058638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.059090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.059869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.060314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.081369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:04.082010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:04.088268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.088718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.089526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.089963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.268187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:04.271937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:04.276522 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:04.278029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:04.279180 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-35a399ee-3cfd-4599-aebe-f9573d49d387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.231738 Dec 08 11:36:04.279302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-38717e30-9a68-40ba-9b3a-fed361b04a65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.201457 Dec 08 11:36:04.285320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 398/798] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:04 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:04.285476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 401/799] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:04 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:04.285571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:04.285571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:04.290832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.291288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.292081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.292522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.386048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:04.386663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:04.392766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.393241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.394030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:04.394468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:04.424112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:04.433722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.152922 Dec 08 11:36:04.434484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 399/800] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:04 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:04.535900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:04.544859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.162005 Dec 08 11:36:04.545640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 402/801] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:04 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:05.296101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:05.297396 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:05.298927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:05.299644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:05.305501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.306204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.307317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.307931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.309314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.311330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.312356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.312877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.500566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:05.504555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:05.508546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.216047 Dec 08 11:36:05.509113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 400/802] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:05 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:05.513303 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:05.513902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:05.516917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:05.518628 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:05.519681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.519806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-46d08822-caf4-4c10-8e96-e02f2503fdde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.225597 Dec 08 11:36:05.520133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.520318 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 403/803] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:05 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:05.520909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.521385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.561389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:05.562122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:05.568316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.568776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.569605 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:05.570047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:05.692716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:05.700561 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ab897cd9-9667-43a0-8524-0a52a9f6e318 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.190390 Dec 08 11:36:05.701403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 401/804] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:05 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:05.748511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:05.756177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.198292 Dec 08 11:36:05.756742 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 404/805] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:05 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:06.525739 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:06.526461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:06.532992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.533478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.534276 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.534715 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.537961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:06.538957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:06.547468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.547917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.551266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.551750 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.703368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:06.710918 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8987ec94-9229-4b75-897e-44719dccfb8d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.188912 Dec 08 11:36:06.711836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 402/806] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:06 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:06.717101 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:06.717804 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:06.723819 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.724384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.725269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.725797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.778482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:06.786849 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:06.788363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:06.789579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.255341 Dec 08 11:36:06.790139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 405/807] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:06 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:06.795532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:06.795532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:06.801609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.802066 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.802860 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:06.803301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:06.897225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:06.904384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-36404350-b322-459c-aa5b-75a02b1a9285 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.190882 Dec 08 11:36:06.904946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 403/808] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:06 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:06.956838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:06.964001 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ebb3a834-189a-4846-80e2-31e333e705ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.172934 Dec 08 11:36:06.964559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 406/809] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:06 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:07.727662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:07.728301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:07.734532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:07.734982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:07.735766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:07.736203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:07.807869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:07.808481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:07.815168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:07.815625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:07.816467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:07.816911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:07.998569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:08.005974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:08.006219 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3d1af8db-f035-44a8-aaa0-c7143f25266f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.282253 Dec 08 11:36:08.006786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 404/810] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:07 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:08.011030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:08.011632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:08.014703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:08.016254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:08.017973 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:08.018455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:08.018601 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1d6bd89d-7ded-48a0-a622-38863293e2de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.214114 Dec 08 11:36:08.019004 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 407/811] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:07 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:08.019232 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:08.019670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:08.077176 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:08.077806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:08.085082 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:08.085577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:08.086462 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:08.086800 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:08.181585 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:08.206120 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-263a027a-73e3-423a-9d3b-80353c40b726 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.198209 Dec 08 11:36:08.206850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 405/812] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:08 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:08.244577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:08.252581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.232534 Dec 08 11:36:08.253083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 408/813] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:08 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:09.023528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:09.024158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:09.030467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.030930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.031720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.032168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.036086 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:09.036690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:09.042797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.043250 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.044032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.044480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.238406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:09.246572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:09.248099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:09.249336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.217489 Dec 08 11:36:09.260386 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 409/814] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:09 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:09.264966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:09.266575 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:09.268006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:09.274301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.274678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.275481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.275921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.286517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1bcf7694-bd47-480a-87e9-80ec97c867b5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.266553 Dec 08 11:36:09.287444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 406/815] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:09 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:09.292144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:09.292819 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:09.298663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.299209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.300111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:09.300615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:09.481382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:09.488220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:09.488963 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-183588d1-6d78-4966-bddc-13a0927c1031 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.227499 Dec 08 11:36:09.489661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 410/816] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:09 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:09.495570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-42f7b5af-4207-42e3-a4f6-a525175a88cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.206928 Dec 08 11:36:09.496129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 407/817] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:09 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:10.267763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:10.268371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:10.274691 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.275139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.275949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.276385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.303598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:10.304203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:10.310513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.310960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.311733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.312166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.460158 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:10.468524 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:10.470227 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:10.471450 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.207793 Dec 08 11:36:10.472453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 411/818] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:10 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:10.487682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:10.494885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.194891 Dec 08 11:36:10.495446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 408/819] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:10 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:10.506079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:10.506727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:10.512098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:10.512658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.512845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:10.513115 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.513936 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.514386 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.518789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.519237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.520006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:10.520440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:10.716612 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:10.720985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:10.724269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7967208f-95c1-47a1-a78d-ac9d218cfa51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.215571 Dec 08 11:36:10.724838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 409/820] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:10 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:10.736964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.234168 Dec 08 11:36:10.737654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 412/821] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:10 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:11.488585 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:11.489298 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:11.496721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.497203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.498142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.498589 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.512131 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:11.513706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:11.521551 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.522115 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.522934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.523556 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.697750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:11.706425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:11.707911 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:11.709214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5864ca2a-1001-4eae-a151-c86df27e6224 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.224348 Dec 08 11:36:11.709644 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 410/822] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:11 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:11.711843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:11.719103 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.210948 Dec 08 11:36:11.719659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 413/823] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:11 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:11.739919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:11.740461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:11.746180 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.746629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.747393 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.747822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.755680 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:11.756299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:11.762144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.762607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.763403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:11.763853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:11.948266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:11.951553 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:11.955710 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6943333d-2204-4d38-a348-ddd3e4198e3e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.203578 Dec 08 11:36:11.956276 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 414/824] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:11 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:11.959012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-af00c312-a46f-4da0-aeff-817d5498627a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.222634 Dec 08 11:36:11.959557 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 411/825] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:11 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:12.727252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:12.727862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:12.734407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.734863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.735651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.735761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:12.736163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.736316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:12.742760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.743205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.743981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.744411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.929978 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:12.934044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:12.938851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:12.940387 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:12.941386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.209512 Dec 08 11:36:12.941572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aefa010f-91a8-432a-973f-4896de939391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.218088 Dec 08 11:36:12.941952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 412/826] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:12 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:12.942375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 415/827] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:12 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:12.972413 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:12.973022 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:12.975549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:12.976156 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:12.978861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.979252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.980046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.980490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.981892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.982339 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:12.983146 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:12.983581 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:13.174724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:13.179079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:13.182287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-23db0dde-c62d-416c-ae00-a91b3848cc68 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.213830 Dec 08 11:36:13.182858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 413/828] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:12 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:13.186766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.214632 Dec 08 11:36:13.187426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 416/829] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:12 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:13.958451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:13.959068 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:13.959172 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:13.959741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:13.965292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:13.965742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:13.965968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:13.966428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:13.966594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:13.966938 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:13.967209 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:13.967647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:14.163351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:14.166995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:14.170939 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9e182d38-9bf8-4401-887b-08db3948e029 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.216412 Dec 08 11:36:14.171519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 414/830] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:13 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:14.175224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:14.176728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:14.177907 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.222493 Dec 08 11:36:14.178491 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 417/831] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:13 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:14.199040 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:14.199648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:14.203315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:14.203934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:14.206074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:14.206530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:14.207323 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:14.207762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:14.210192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:14.210586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:14.211374 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:14.211816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:14.402315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:14.410434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1234965b-0c51-42d6-bd60-75e02c5d84af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.214888 Dec 08 11:36:14.411086 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:14.411365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 415/832] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:14 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:14.419358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.219332 Dec 08 11:36:14.420221 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 418/833] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:14 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:15.187825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:15.188465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:15.196372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:15.197205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:15.198174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.198634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.199695 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.200459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.203717 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.204242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.205112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.205654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.389246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:15.396693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f4d62b8e-dce0-4129-adb2-4547294ff7bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.212509 Dec 08 11:36:15.397293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 416/834] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:15 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:15.404927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:15.413811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:15.415309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:15.416458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d60fe623-274d-4c60-9fd6-7effbbf4823c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.224011 Dec 08 11:36:15.417016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 419/835] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:15 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:15.427162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:15.427867 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:15.434035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.434563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.435580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.436176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.437936 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:15.438624 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:15.445214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.445729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.446597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:15.447102 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:15.659536 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:15.660162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:15.668256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-18ebe35b-5061-4506-b57f-e703ae197379 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.235840 Dec 08 11:36:15.669054 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 420/836] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:15 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:15.673735 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f56a6623-2262-4d64-bba7-4e5f842de9f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.250704 Dec 08 11:36:15.674311 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 417/837] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:15 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:16.413593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:16.414150 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:16.420348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.420801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.421607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.422047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.435363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:16.435978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:16.443278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.443739 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.444529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.444971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.618807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:16.625539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:16.626244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-405f24d5-d50a-438f-aef4-e41e1d050a5e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.216419 Dec 08 11:36:16.627469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 421/838] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:16 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:16.634634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:16.636225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:16.637395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f0456fbf-8257-4680-a9d7-d895674e170f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.205669 Dec 08 11:36:16.637948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 418/839] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:16 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:16.684932 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:16.685511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:16.690617 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:16.691343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:16.691877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.692333 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.693119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.693587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.696990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.697479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.698256 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:16.698693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:16.890979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:16.894429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:16.898652 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.217214 Dec 08 11:36:16.899293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 422/840] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:16 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:16.902304 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5a853553-233e-4ff5-a0a7-358436ccd34d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.215656 Dec 08 11:36:16.902861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 419/841] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:16 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:17.643482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:17.644096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:17.650360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.650812 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.651588 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.652026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.655364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:17.655976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:17.662758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.663210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.663991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.664429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.843846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:17.850788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:17.851053 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3ebf502b-fedb-4e49-acac-74ca386a53fe tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.211490 Dec 08 11:36:17.851617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 423/842] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:17 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:17.859271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:17.860834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:17.862024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.210350 Dec 08 11:36:17.862578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 420/843] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:17 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:17.915415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:17.916163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:17.918951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:17.919638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:17.922321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.922773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.924127 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.924560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.925834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.926284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:17.927055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:17.927489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:18.118595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:18.122723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:18.126159 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.214380 Dec 08 11:36:18.126725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 424/844] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:17 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:18.129933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-be591780-daf3-40fc-b65b-d89cec2a1ee2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.214483 Dec 08 11:36:18.130605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 421/845] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:17 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:18.867591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:18.868207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:18.874512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:18.874894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:18.875681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:18.876177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:18.879703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:18.880317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:18.886587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:18.887041 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:18.887827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:18.888270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:19.072601 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:19.075610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:19.080850 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.216920 Dec 08 11:36:19.081873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 425/846] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:18 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:19.085060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:19.086600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:19.087765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.212110 Dec 08 11:36:19.088493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 422/847] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:18 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:19.143584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:19.144133 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:19.146665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:19.147272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:19.150040 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:19.150498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:19.151288 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:19.151730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:19.152942 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:19.153441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:19.154249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:19.154682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:19.340960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:19.344544 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:19.348271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a888269a-3e99-42fe-b8cf-e0211c72afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.209209 Dec 08 11:36:19.348972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 426/848] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:19 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:19.351858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3b1cf960-6654-47f1-b24a-2db9a82fd711 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.208624 Dec 08 11:36:19.352419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 423/849] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:19 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:20.098816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:20.100480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:20.106742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:20.107690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.108155 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.108794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:20.109019 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.109419 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.120587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.121365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.122385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.123035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.496767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:20.502885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:20.504691 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.410161 Dec 08 11:36:20.511592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:20.513076 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:20.514257 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 427/850] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:20 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:20.514543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.412123 Dec 08 11:36:20.515099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 424/851] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:20 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:20.518958 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:20.519565 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:20.519792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:20.520397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:20.525346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.525870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.526193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.526660 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.526773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.527097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.527687 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:20.528247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:20.716781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:20.720975 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:20.724300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c931f154-6893-4528-81ed-e5d864df8154 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.208262 Dec 08 11:36:20.724865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 425/852] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:20 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:20.728201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3c959831-ca10-417e-ae1c-f25a6b211045 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.213021 Dec 08 11:36:20.728894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 428/853] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:20 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:21.522232 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:21.522837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:21.529270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.529727 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.530517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.530972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.531922 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:21.532540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:21.538889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.539358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.540154 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.540595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.720459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:21.724417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:21.727788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.209144 Dec 08 11:36:21.728363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 426/854] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:21 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:21.732654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:21.734172 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:21.735350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b2389bc3-e986-475d-b993-dadfe39451c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.207196 Dec 08 11:36:21.735897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 429/855] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:21 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:21.741595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:21.742293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:21.744077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:21.744689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:21.748369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.748824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.749638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.750105 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.750500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.750954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.751885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:21.752876 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:21.940227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:21.944326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:21.948149 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.210447 Dec 08 11:36:21.948716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 427/856] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:21 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:21.952196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0eb7520f-a9a3-470f-aea7-fe638538b801 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.211427 Dec 08 11:36:21.952835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 430/857] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:21 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:22.745511 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:22.746078 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:22.752935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.753422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.753995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:22.754397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.754599 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:22.754727 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.760951 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.761427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.762221 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.762695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.945886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:22.952917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:22.953305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2002b95f-6d42-496d-bf91-3152ac6eb867 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1319 microversion: 2.1 time: 0.211418 Dec 08 11:36:22.954027 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 428/858] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:22 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:22.961784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:22.963274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:22.964425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-403dbd96-634b-47ad-8248-d454e05a5e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.214569 Dec 08 11:36:22.964976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 431/859] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:22 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:22.965922 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:22.966542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:22.969029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:22.969667 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:22.972821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.973428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.974326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.974878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.975267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.975726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:22.976511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:22.976952 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:23.168737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:23.171972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:23.176926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-92b9b816-1f7e-47dc-9778-a13b78b5149c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.215965 Dec 08 11:36:23.177907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 429/860] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:22 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:23.180397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4fa2485f-5881-41c1-8adf-12b460878e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1511 microversion: 2.1 time: 0.214417 Dec 08 11:36:23.181033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 432/861] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:22 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:23.970784 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:23.971424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:23.979503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:23.980155 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:23.980972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:23.981439 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:23.992822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:23.994446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:24.005996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.006707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.008179 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.009140 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.155335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:24.164032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-85b03fd2-036d-42d8-870f-39a7790c01f0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1509 microversion: 2.1 time: 0.196815 Dec 08 11:36:24.176818 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 430/862] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:23 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:24.182034 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-f7868921-c024-480d-b4f1-40d5ced948f5 req-a32591a1-3d3c-4bb5-983a-24c3d5562669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "name": "network-vif-deleted", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:24.183832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:24.183832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:36:24.202115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-f7868921-c024-480d-b4f1-40d5ced948f5 req-a32591a1-3d3c-4bb5-983a-24c3d5562669 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.203387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-f7868921-c024-480d-b4f1-40d5ced948f5 req-a32591a1-3d3c-4bb5-983a-24c3d5562669 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.219926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-f7868921-c024-480d-b4f1-40d5ced948f5 req-a32591a1-3d3c-4bb5-983a-24c3d5562669 service nova] Creating event network-vif-deleted:222531bb-d35b-49bb-b52a-9b0f529866e2 for instance 16a3dc0f-c35b-4f26-b4da-455158247814 on hv-cinder-81977 Dec 08 11:36:24.224876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-f7868921-c024-480d-b4f1-40d5ced948f5 req-a32591a1-3d3c-4bb5-983a-24c3d5562669 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046680 Dec 08 11:36:24.225716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 431/863] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:24.230510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "742f4b40-b7d3-48de-b15e-ce168f3e115c", "device": "/dev/sdb"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:24.231726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:24.238396 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.238949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.239632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.240074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.324801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:24.333787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:24.335272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:24.336430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d857d20b-c5c4-4946-8261-cc9e5beae874 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.356799 Dec 08 11:36:24.336986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 433/864] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:23 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:24.341093 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:24.341719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:24.347123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.347582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.348360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.348804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.496616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-12a43696-6461-4d9f-b838-67b15ac86736 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "POST /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269687 Dec 08 11:36:24.497251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 432/865] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:36:24 2021] POST /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:24.502741 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:24.503447 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:24.509603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.510465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.510858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.511300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.527126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:24.534810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1509 microversion: 2.1 time: 0.196689 Dec 08 11:36:24.535535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 434/866] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:24 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:24.556467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:24.558394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:24.558394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'fault' on Instance uuid 16a3dc0f-c35b-4f26-b4da-455158247814 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:24.619528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:24.628855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-67c51551-d449-4bb2-9e67-5fc45e14326a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 200 len: 1307 microversion: 2.1 time: 0.130474 Dec 08 11:36:24.629455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 433/867] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:24 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:25.451474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:25.452142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:25.458544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.458996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.459784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.460220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.551551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:25.552843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:25.562204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.562956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.564231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.572007 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.607869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:25.614252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.614762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.615208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lazy-loading 'fault' on Instance uuid f4f33a56-55e3-4bc1-a952-b90b6fde964c {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:25.623583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:25.633819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:25.635151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.284462 Dec 08 11:36:25.635921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 435/868] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:25 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:25.649986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:25.650968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 16a3dc0f-c35b-4f26-b4da-455158247814] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:25.664009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.665111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.666676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:25.667328 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:25.667873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:25.677960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-41d05ca9-5d05-4d53-9827-da3306e0afeb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 200 len: 1312 microversion: 2.1 time: 0.130149 Dec 08 11:36:25.681238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 434/869] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:25 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:25.682025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] HTTP exception thrown: Instance 16a3dc0f-c35b-4f26-b4da-455158247814 could not be found. Dec 08 11:36:25.682719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Returning 404 to user: Instance 16a3dc0f-c35b-4f26-b4da-455158247814 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:25.683648 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-95140135-40a6-47e0-8a6c-8be110f60772 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814" status: 404 len: 111 microversion: 2.1 time: 0.038811 Dec 08 11:36:25.689056 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 436/870] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:25 2021] GET /compute/v2.1/servers/16a3dc0f-c35b-4f26-b4da-455158247814 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 08 11:36:26.308347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-a4d3e85e-ae7e-45f7-bf97-707ef77b3b3d req-85e28ac8-b119-4e4c-802b-e235e175de70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "name": "network-vif-deleted", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:26.309941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:26.309941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:36:26.316576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a4d3e85e-ae7e-45f7-bf97-707ef77b3b3d req-85e28ac8-b119-4e4c-802b-e235e175de70 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.317011 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a4d3e85e-ae7e-45f7-bf97-707ef77b3b3d req-85e28ac8-b119-4e4c-802b-e235e175de70 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.327320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-a4d3e85e-ae7e-45f7-bf97-707ef77b3b3d req-85e28ac8-b119-4e4c-802b-e235e175de70 service nova] Creating event network-vif-deleted:ec0c1efb-b1b3-47b8-91c5-b30707a7222f for instance f4f33a56-55e3-4bc1-a952-b90b6fde964c on hv-cinder-81977 Dec 08 11:36:26.332466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-a4d3e85e-ae7e-45f7-bf97-707ef77b3b3d req-85e28ac8-b119-4e4c-802b-e235e175de70 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086469 Dec 08 11:36:26.333014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 435/871] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:26.660293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:26.660902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:26.667187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.667637 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.668419 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.668850 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.696414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:26.697256 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: f4f33a56-55e3-4bc1-a952-b90b6fde964c] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:26.703370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.703894 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.704773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.705890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.718967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] HTTP exception thrown: Instance f4f33a56-55e3-4bc1-a952-b90b6fde964c could not be found. Dec 08 11:36:26.719647 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Returning 404 to user: Instance f4f33a56-55e3-4bc1-a952-b90b6fde964c could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:26.720581 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-232eccc7-a0d8-4824-930b-2d01c9509d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c" status: 404 len: 111 microversion: 2.1 time: 0.028251 Dec 08 11:36:26.724036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 436/872] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:26 2021] GET /compute/v2.1/servers/f4f33a56-55e3-4bc1-a952-b90b6fde964c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 08 11:36:26.728708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:26.729225 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:26.734860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.735305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.736081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.736512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.760618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:36:26.804216 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:26.813529 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:26.815787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:26.817892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9138a200-1909-4911-bf14-7643d4e73202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.160399 Dec 08 11:36:26.817892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 437/873] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:26 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:26.834014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:26.834514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:26.840833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.841315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.841900 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-43e4d573-87ef-45a7-8e29-105fb8c5e69b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 204 len: 0 microversion: 2.1 time: 0.116293 Dec 08 11:36:26.842124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.842480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 437/874] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:36:26 2021] DELETE /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 08 11:36:26.842656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.851209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:26.852075 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:26.857983 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.858437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.859222 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.859663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.867954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:36:26.942859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 204 len: 0 microversion: 2.1 time: 0.112876 Dec 08 11:36:26.943440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 438/875] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:36:26 2021] DELETE /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:36:26.951392 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:26.952099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:26.957947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.958400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.959187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:26.959629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:26.994368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:27.001736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a5b6eb79-3ecf-44af-ae18-186c941f710a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.154770 Dec 08 11:36:27.003473 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 438/876] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:26 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:27.104712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:27.112789 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-33e38105-98c8-4417-ab8a-d736762c896c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1511 microversion: 2.1 time: 0.165057 Dec 08 11:36:27.113371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 439/877] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:26 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:27.835730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:27.836329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:27.842570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:27.843016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:27.843785 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:27.844221 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:27.969209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:27.977753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:27.979226 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:27.980380 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d17532fd-a57e-473b-aafc-4be748b3ff71 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.148317 Dec 08 11:36:27.980921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 439/878] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:27 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:28.020206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:28.020829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:28.027192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:28.027654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:28.028441 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:28.028883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:28.130546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:28.131162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:28.137374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:28.137831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:28.138615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:28.139051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:28.159856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:28.170851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-488e62ed-19a4-4383-899c-b49c2183c045 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.155035 Dec 08 11:36:28.180194 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 440/879] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:28 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:28.271603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:28.279099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d983edc4-699a-44df-8c75-c3f6375a5030 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1511 microversion: 2.1 time: 0.152663 Dec 08 11:36:28.279667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 440/880] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:28 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:28.998191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:28.998798 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:29.004490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.004943 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.005766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.006209 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.056779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:29.057799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:29.064012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.064469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.065277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.065951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.139908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:29.149616 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:29.151110 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:29.152304 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.157832 Dec 08 11:36:29.152933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 441/881] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:28 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:29.187794 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:29.188407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:29.194555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.195009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.195806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.196241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.286890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-03a16120-c3bb-4c11-8e18-f8c92a60365e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/action" status: 202 len: 0 microversion: 2.1 time: 0.233812 Dec 08 11:36:29.287514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 441/882] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:36:29 2021] POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:36:29.296820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:29.297827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:29.304123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.305043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.305404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.305920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.339241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:29.347295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-26dfc568-5861-4f00-865c-4182175ec499 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.163285 Dec 08 11:36:29.357585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 442/883] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:29 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:29.357585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:29.357585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:29.358562 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.359079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.359880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:29.360352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:29.483272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:29.490900 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-daa062ee-9bfb-49a0-a057-60549270b333 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1511 microversion: 2.1 time: 0.199057 Dec 08 11:36:29.497349 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 442/884] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:29 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:29.569956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:29.577680 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bd56ff4b-d51a-47af-a1db-9e265d019f58 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1750 microversion: 2.1 time: 0.228865 Dec 08 11:36:29.578244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 443/885] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:29 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:30.171463 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:30.172210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:30.179059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.179514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.180302 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.180766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.364359 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:30.365892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:30.372043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.372619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.373723 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.374166 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.400194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:30.409533 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:30.411025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:30.412179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.244771 Dec 08 11:36:30.412722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 443/886] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:30 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:30.509922 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:30.510606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:30.517100 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.519293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.520770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.521461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.603687 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:30.613087 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e48876bc-9cbc-403e-bd50-1a8704cc4805 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 200 len: 1469 microversion: 2.1 time: 0.108539 Dec 08 11:36:30.614651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 444/887] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:30 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 1469 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:30.619651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-23b4030e-54d1-43ef-8d50-abe195167613 req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "name": "network-vif-deleted", "tag": "be511646-f492-43f2-af08-bc641afcd8a2"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:30.621365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:30.621365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:36:30.629671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-23b4030e-54d1-43ef-8d50-abe195167613 req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.630224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-23b4030e-54d1-43ef-8d50-abe195167613 req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.643519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-23b4030e-54d1-43ef-8d50-abe195167613 req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 service nova] Creating event network-vif-deleted:be511646-f492-43f2-af08-bc641afcd8a2 for instance 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 on hv-cinder-81977 Dec 08 11:36:30.648539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-23b4030e-54d1-43ef-8d50-abe195167613 req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Dec 08 11:36:30.649426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 445/888] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:30.653417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:30.654885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:30.655664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:30.662573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.663306 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.664356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:30.664855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:30.669371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.309223 Dec 08 11:36:30.670388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 444/889] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:30 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:30.813499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:30.823766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.173285 Dec 08 11:36:30.824334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 446/890] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:30 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:31.430453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:31.430975 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:31.437490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.437949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.438740 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.439362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.566896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:31.575033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:31.576512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:31.577687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7308122c-3fc3-49ac-8edb-8ec48a767d76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.151116 Dec 08 11:36:31.578235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 445/891] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:31 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:31.629724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:31.630331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:31.636473 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.636919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.637710 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.638147 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.651347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] HTTP exception thrown: Instance 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 could not be found. Dec 08 11:36:31.651916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Returning 404 to user: Instance 01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:31.652704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e000a73c-723f-4ef9-bae3-a5138405ff73 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321" status: 404 len: 111 microversion: 2.1 time: 0.026646 Dec 08 11:36:31.653249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 447/892] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:31 2021] GET /compute/v2.1/servers/01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:36:31.661542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:31.662047 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:31.667844 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.668296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.669081 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.669541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.686432 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:31.686968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:31.692693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.693029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:36:31.693137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.693926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.694355 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.783899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 204 len: 0 microversion: 2.1 time: 0.125763 Dec 08 11:36:31.785656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 446/893] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:36:31 2021] DELETE /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:36:31.795011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:31.796076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:31.802594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.803138 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.804230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.804896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.879428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:31.887287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-09bd509f-0384-4d20-89c2-ae670ce50e8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.204040 Dec 08 11:36:31.897960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 448/894] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:31 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:31.904747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:31.905489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:31.912184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.912790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.913802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:31.914304 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:31.956136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:31.964118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e33af474-356d-4feb-aa86-2696966dcf5b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.174348 Dec 08 11:36:31.964911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 447/895] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:31 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:32.074450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:32.082772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.182709 Dec 08 11:36:32.083320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 449/896] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:31 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:32.596577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:32.597211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:32.603523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:32.603982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:32.604766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:32.605233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:32.732717 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:32.741445 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:32.742947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:32.744106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.151776 Dec 08 11:36:32.744661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 448/897] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:32 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:32.906409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:32.906977 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:32.913844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:32.914282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:32.915059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:32.915505 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:32.981067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:32.981804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:32.988442 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:32.988880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:32.989691 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:32.990217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:33.073113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:33.092941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bc8eb87b-c834-4724-b867-7b65790ede04 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.190103 Dec 08 11:36:33.104426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 450/898] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:32 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:33.109986 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:33.110611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:33.117021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:33.117474 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:33.118295 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:33.118819 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:33.154548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:33.162846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e092af76-a1b9-407b-b67e-953bb1173c15 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.185342 Dec 08 11:36:33.175787 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 449/899] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:32 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:33.288712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:33.296757 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.191074 Dec 08 11:36:33.297333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 451/900] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:33 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:33.762518 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:33.763128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:33.770174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:33.770629 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:33.771414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:33.771854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:33.901440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:33.910184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:33.911710 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:33.912857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-826aea66-a86e-4002-bd9f-6312ca11de8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.154058 Dec 08 11:36:33.913440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 450/901] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:33 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:34.110603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:34.111273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:34.117510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.117963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.118731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.119169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.181532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:34.182147 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:34.187950 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.188508 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.190321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.190321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.280638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:34.288153 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.181149 Dec 08 11:36:34.288720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 452/902] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:34 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:34.313342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:34.314449 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:34.320146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.320586 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.321384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.321825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.339231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:34.346420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-faceb7c5-3501-49cf-920c-14f3da114fc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.168526 Dec 08 11:36:34.347277 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 451/903] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:34 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:34.462120 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:34.469744 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-539edc37-ee75-4feb-ba26-521b48587cf9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.159897 Dec 08 11:36:34.470317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 453/904] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:34 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:34.931302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:34.931906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:34.938097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.938543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:34.939824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:34.940256 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.074330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:35.083097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:35.084633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:35.085929 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-37760cb2-7425-4d43-9517-426f1be35cf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.158286 Dec 08 11:36:35.086344 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 452/905] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:34 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:35.304973 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:35.305638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:35.311851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:35.312301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.313077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:35.313542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.362840 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:35.363586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:35.369722 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:35.370170 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.370974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:35.371408 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.475176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:35.482576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fad8422d-07de-47dd-aea7-8bf1602f8a93 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.181189 Dec 08 11:36:35.483292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 454/906] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:35 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:35.488005 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:35.488608 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:35.494376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:35.494837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.495627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:35.496073 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:35.548373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:35.556146 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c4fb84cd-a1cf-474e-a276-20300b650d1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.197507 Dec 08 11:36:35.556701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 453/907] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:35 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:35.646036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:35.654168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-503a0b40-b38b-435c-9b5c-161b66a7be99 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.169994 Dec 08 11:36:35.654746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 455/908] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:35 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:36.103625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:36.104235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:36.110486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.110953 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.111728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.112162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.242137 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:36.250213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:36.252200 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:36.253394 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-813040ee-f8c3-45c3-b38d-b7c4ba692255 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.153540 Dec 08 11:36:36.253939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 454/909] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:36 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:36.499595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:36.500163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:36.507014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.507471 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.508252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.508692 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.572413 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:36.573138 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:36.579131 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.580182 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.580979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.581444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.665837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:36.673790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-54753fbb-a9e1-4541-8020-90110c1084ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.177324 Dec 08 11:36:36.674627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 456/910] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:36 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:36.687684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:36.688286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:36.695949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.696398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.697199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.697640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.753985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:36.761336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.192562 Dec 08 11:36:36.771363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 455/911] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:36 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:36.775996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-b97512bb-2b11-439f-adf0-00c6db9832f2 req-c04a4af9-f1d5-4538-b348-536072a7e7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:36.777617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:36.777617 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:36:36.784440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-b97512bb-2b11-439f-adf0-00c6db9832f2 req-c04a4af9-f1d5-4538-b348-536072a7e7c2 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:36.785305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-b97512bb-2b11-439f-adf0-00c6db9832f2 req-c04a4af9-f1d5-4538-b348-536072a7e7c2 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:36.805782 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-b97512bb-2b11-439f-adf0-00c6db9832f2 req-c04a4af9-f1d5-4538-b348-536072a7e7c2 service nova] Creating event network-vif-plugged:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:36:36.811735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-b97512bb-2b11-439f-adf0-00c6db9832f2 req-c04a4af9-f1d5-4538-b348-536072a7e7c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039130 Dec 08 11:36:36.814701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 456/912] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:36.870611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:36.879132 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a731f820-b757-4ea7-9881-dd0ffff5de5c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.194875 Dec 08 11:36:36.879696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 457/913] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:36 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:37.272137 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:37.272835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:37.278777 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.279229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.280017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.280459 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.411191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:37.419215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:37.420688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:37.421867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e8cba448-c23c-4f66-a110-46d3978cc6ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.154211 Dec 08 11:36:37.422428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 457/914] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:37 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:37.689860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:37.690369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:37.696513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.696962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.697841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.698275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.778259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:37.778865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:37.784776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.785261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.786057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.786496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.834877 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:37.842200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d37ab16a-6dff-4814-ac49-9de01d49f6ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.156088 Dec 08 11:36:37.842839 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 458/915] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:37 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:37.896371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:37.896997 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:37.902835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.903290 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.904077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:37.904520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:37.921400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:37.928740 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0fd38092-968e-44e4-bf22-bba65c12cda0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.154130 Dec 08 11:36:37.929428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 458/916] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:37 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:38.045255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:38.052890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.160756 Dec 08 11:36:38.053481 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 459/917] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:37 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:38.442678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:38.443303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:38.449891 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:38.450979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:38.451783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:38.452226 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:38.578619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:38.586793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:38.588282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:38.589454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7cf16a7d-4195-4a96-801f-08ee728a48f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.153551 Dec 08 11:36:38.590009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 459/918] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:38 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:38.861455 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:38.862073 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:38.868368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:38.868824 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:38.869634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:38.870076 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:38.945694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:38.946340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:38.952243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:38.952708 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:38.953530 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:38.953976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:39.026143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:39.033839 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-562d028f-d6f1-46d4-912b-3890017f4659 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.176169 Dec 08 11:36:39.034396 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 460/919] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:38 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:39.069756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:39.070362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:39.076056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:39.076504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:39.077319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:39.077752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:39.094170 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:39.102123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ace33f38-8bb4-4342-8ff6-be18682d6f3e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.160061 Dec 08 11:36:39.102979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 460/920] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:38 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:39.224089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:39.231777 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d8124738-6146-4581-9047-c9627e982f91 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.165648 Dec 08 11:36:39.232332 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 461/921] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:39 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:39.607719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:39.608330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:39.614582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:39.615034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:39.615825 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:39.616261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.050865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:40.051510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:40.059487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.059487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.059487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.059871 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.174238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:40.182715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:40.184271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:40.185467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.581542 Dec 08 11:36:40.186348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 461/922] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:39 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:40.191862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:40.191862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:40.199362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.199894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.200751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.201310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.537390 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:40.544873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-81e49a30-9f64-459a-9724-13757a7eead6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1521 microversion: 2.1 time: 0.498279 Dec 08 11:36:40.545540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 462/923] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:40 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:40.552812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:40.553723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:40.559476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.560233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.560631 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.561071 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.639968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:40.648486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a693b43c-e0e5-4740-81c2-4283bfe69f25 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1512 microversion: 2.1 time: 0.461152 Dec 08 11:36:40.649052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 462/924] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:40 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:40.653379 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-c4aab2ea-a6f2-46fb-8fee-9715196b45a9 req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "name": "network-vif-deleted", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:40.655075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:40.655075 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:36:40.662483 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-c4aab2ea-a6f2-46fb-8fee-9715196b45a9 req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:40.662926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-c4aab2ea-a6f2-46fb-8fee-9715196b45a9 req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:40.675373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-c4aab2ea-a6f2-46fb-8fee-9715196b45a9 req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 service nova] Creating event network-vif-deleted:1d5f08a0-9b25-48d8-a2ed-88647aec1670 for instance 96e47acb-aeed-4636-9a70-a1b987abaed6 on hv-cinder-81977 Dec 08 11:36:40.680369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-c4aab2ea-a6f2-46fb-8fee-9715196b45a9 req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030164 Dec 08 11:36:40.680961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 463/925] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:40.827899 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:40.836175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.286755 Dec 08 11:36:40.836733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 463/926] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:40 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:41.204702 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:41.205531 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:41.211598 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.212053 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.212839 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.213327 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.345280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:41.353534 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:41.355046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:41.356186 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-47936368-6b45-4b0c-89ad-a0bc28709df0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.155616 Dec 08 11:36:41.356736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 464/927] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:41 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:41.561012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:41.561660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:41.567960 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.568415 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.569220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.569665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.628260 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:41.635346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1479 microversion: 2.1 time: 0.077957 Dec 08 11:36:41.635929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 464/928] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:41 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1479 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:41.665996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:41.666689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:41.672900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.673977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.674766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.675212 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.732357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:41.740167 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1303 microversion: 2.1 time: 0.077776 Dec 08 11:36:41.740727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 465/929] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:41 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1303 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:41.853032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:41.853672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:41.859663 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.860111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:41.861467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:41.861917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.002703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:42.010433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f5d8ca50-b488-4675-8488-1e10d8863fd1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.161055 Dec 08 11:36:42.010997 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 465/930] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:41 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:42.374588 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:42.375225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:42.381646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.382099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.382870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.383306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.509398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:42.518308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:42.519797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:42.520941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.150012 Dec 08 11:36:42.521520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 466/931] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:42 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:42.651389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:42.652001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:42.658248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.658700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.659483 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.659919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.708297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-0d4f3bb1-7170-4780-99f6-f71e2f433c5d req-55fff654-fc5b-4860-8461-9bb71f5e29d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "name": "network-vif-deleted", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:42.709835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:42.709835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:36:42.716879 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-0d4f3bb1-7170-4780-99f6-f71e2f433c5d req-55fff654-fc5b-4860-8461-9bb71f5e29d0 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.717380 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-0d4f3bb1-7170-4780-99f6-f71e2f433c5d req-55fff654-fc5b-4860-8461-9bb71f5e29d0 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.723394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:42.728430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-0d4f3bb1-7170-4780-99f6-f71e2f433c5d req-55fff654-fc5b-4860-8461-9bb71f5e29d0 service nova] Creating event network-vif-deleted:96b6dc81-7654-48f5-ac3f-e3e4d35982b3 for instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d on hv-cinder-81977 Dec 08 11:36:42.730638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1479 microversion: 2.1 time: 0.082811 Dec 08 11:36:42.731199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 466/932] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:42 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1479 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:42.733466 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-0d4f3bb1-7170-4780-99f6-f71e2f433c5d req-55fff654-fc5b-4860-8461-9bb71f5e29d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 Dec 08 11:36:42.734035 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 467/933] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:36:42.756910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:42.757558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:42.764278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.764728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.765535 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:42.765995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:42.823348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:42.831048 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1303 microversion: 2.1 time: 0.077658 Dec 08 11:36:42.831594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 467/934] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:42 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1303 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:43.028455 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:43.029160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:43.035189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.035646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.036414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.036847 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.181439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:43.189657 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.165203 Dec 08 11:36:43.190219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 468/935] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:43 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:43.539209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:43.539741 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:43.545514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.545950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.546731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.547175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.680787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:43.689628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:43.691152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:43.692293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.156923 Dec 08 11:36:43.692834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 468/936] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:43 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:43.747341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:43.747981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:43.755085 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.755537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.756310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.756748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.815620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:43.822725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8d522a49-b3f6-4ac0-9d51-e9992b332472 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1479 microversion: 2.1 time: 0.079014 Dec 08 11:36:43.823287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 469/937] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:43 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1479 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:43.847178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:43.847784 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:43.853713 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.854161 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.854929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.855362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.884677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:43.885161 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:43.885620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'fault' on Instance uuid 96e47acb-aeed-4636-9a70-a1b987abaed6 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:43.926582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:43.933610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bfff00d3-0c92-4feb-8883-b7dae715dca6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1308 microversion: 2.1 time: 0.089986 Dec 08 11:36:43.934166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 469/938] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:43 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:44.207204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:44.207815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:44.213609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.214066 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.214848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.215297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.354368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:44.362757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3994e7aa-b9df-4898-9a58-796dcf753a04 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.159685 Dec 08 11:36:44.363323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 470/939] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:44 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:44.710570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:44.711175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:44.717324 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.717778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.718548 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.718979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.839621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:44.840353 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:44.846282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:44.846773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.847225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.848013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.848454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.854341 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:44.855828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:44.856981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.150056 Dec 08 11:36:44.857564 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 470/940] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:44 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:44.911528 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:44.918892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-40fa4750-91c7-4473-b448-45470e806935 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1306 microversion: 2.1 time: 0.082986 Dec 08 11:36:44.919449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 471/941] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:44 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1306 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:44.950632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:44.951247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:44.957050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.957541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.958326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.958768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.987691 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:44.988150 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:44.988599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'fault' on Instance uuid 96e47acb-aeed-4636-9a70-a1b987abaed6 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:45.027211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:45.034400 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d32613d3-a2f7-4504-8641-a2232fa093a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1308 microversion: 2.1 time: 0.087415 Dec 08 11:36:45.034955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 471/942] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:44 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:45.381225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:45.381834 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:45.387666 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:45.388110 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:45.388888 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:45.389364 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:45.530113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:45.537714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.160179 Dec 08 11:36:45.538279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 472/943] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:45 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:45.875056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:45.875656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:45.882551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:45.883139 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:45.883926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:45.884360 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:45.935554 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:45.936096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:45.942781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:45.943231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:45.944014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:45.944451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:46.010817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:46.018373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2c77a58c-6afa-41a8-9df4-266a5734b002 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1306 microversion: 2.1 time: 0.086473 Dec 08 11:36:46.018945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 473/944] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:45 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:46.037966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:46.046044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:46.047537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:46.049283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e2732596-0c33-49e2-9eb5-da8b906cdc4a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.177312 Dec 08 11:36:46.049831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 472/945] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:45 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:46.051448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:46.052192 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:46.057997 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:46.058453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:46.059239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:46.059684 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:46.089727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:46.090301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:46.090642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'fault' on Instance uuid 96e47acb-aeed-4636-9a70-a1b987abaed6 {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:46.136007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:46.143848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5a794f84-8075-4f6d-b204-0f46fea9e861 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 200 len: 1308 microversion: 2.1 time: 0.096674 Dec 08 11:36:46.144419 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 474/946] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:46 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:46.555296 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:46.555843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:46.561975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:46.562438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:46.563234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:46.563676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:46.703449 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:46.711151 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.159625 Dec 08 11:36:46.711708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 473/947] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:46 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:47.034286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:47.034889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:47.041462 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.041928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.042712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.043152 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.066934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:47.067547 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:47.073299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.073746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.073903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.074201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lazy-loading 'fault' on Instance uuid ef74eb6c-4764-40c3-8610-e4f4bc3e610d {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:47.074322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.074993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.075435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.116131 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3919341ead9c45f6b65805b93b7aab32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:47.124145 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-97175596-9b97-4143-b04e-0638bc1c8d63 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 200 len: 1311 microversion: 2.1 time: 0.093959 Dec 08 11:36:47.124721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 475/948] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:47 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:47.161885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:47.162278 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: 96e47acb-aeed-4636-9a70-a1b987abaed6] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:47.168133 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.168591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.169473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.170289 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.183979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] HTTP exception thrown: Instance 96e47acb-aeed-4636-9a70-a1b987abaed6 could not be found. Dec 08 11:36:47.184578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Returning 404 to user: Instance 96e47acb-aeed-4636-9a70-a1b987abaed6 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:47.185589 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c6f7bb66-6962-43a7-a2cf-9ce564cb249a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6" status: 404 len: 111 microversion: 2.1 time: 0.028270 Dec 08 11:36:47.186135 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 476/949] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:47 2021] GET /compute/v2.1/servers/96e47acb-aeed-4636-9a70-a1b987abaed6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 08 11:36:47.213933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:47.223122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:47.224668 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:47.225863 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-25b8c46c-65ac-4319-a215-f33f56a5ed5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.162644 Dec 08 11:36:47.226419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 474/950] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:47 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:36:47.727296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:47.728121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:47.734120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.734434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.735666 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:47.736108 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:47.886466 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:47.900265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fcef9af4-3b07-4f82-b168-44190dd70019 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.176521 Dec 08 11:36:47.901002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 477/951] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:47 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:48.140971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:48.141903 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] [instance: ef74eb6c-4764-40c3-8610-e4f4bc3e610d] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:48.149088 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.149700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.150574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.151124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.167823 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] HTTP exception thrown: Instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d could not be found. Dec 08 11:36:48.168601 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Returning 404 to user: Instance ef74eb6c-4764-40c3-8610-e4f4bc3e610d could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:48.169637 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-622462ae-b6ab-46ed-895a-66b998e2412c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d" status: 404 len: 111 microversion: 2.1 time: 0.032253 Dec 08 11:36:48.170494 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 475/952] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:48 2021] GET /compute/v2.1/servers/ef74eb6c-4764-40c3-8610-e4f4bc3e610d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:36:48.245425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:48.246143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:48.253272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.253799 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.254653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.255160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.319357 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:48.320179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:48.326107 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.327039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.327832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.328266 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.355351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:36:48.437420 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-706508cf-9ace-4994-be76-9801423d804e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 204 len: 0 microversion: 2.1 time: 0.120847 Dec 08 11:36:48.438613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 476/953] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:36:48 2021] DELETE /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:36:48.451375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:48.451781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:48.458522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.459112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.460610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.461174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.574265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:48.582914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:48.584420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:48.585638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1805 microversion: 2.20 time: 0.344075 Dec 08 11:36:48.586554 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 478/954] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:48 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1805 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:48.718264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:48.726352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1512 microversion: 2.1 time: 0.283410 Dec 08 11:36:48.726917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 477/955] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:48 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:48.917917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:48.918535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:48.924331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.924788 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:48.925612 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:48.926059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:49.368490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:49.378802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.464203 Dec 08 11:36:49.379260 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 479/956] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:48 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:49.604169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:49.604784 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:49.612089 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:49.612543 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:49.613376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:49.613817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:49.743357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:49.743975 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:49.749926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:49.750443 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:49.751183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:49.752244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:50.055529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:50.063705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:50.065201 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:50.066350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-07046a9a-f124-440d-9ad2-f6fb666f356c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1792 microversion: 2.20 time: 0.465991 Dec 08 11:36:50.066893 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 478/957] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:36:49 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1792 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:36:50.110030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:50.118213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1512 microversion: 2.1 time: 0.378590 Dec 08 11:36:50.118788 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 480/958] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:49 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:50.397700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:50.398303 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:50.404073 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:50.404522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:50.405342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:50.405779 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:50.740709 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:50.753289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-476a36d7-44c6-4956-9df0-de2ffcc268a3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.360959 Dec 08 11:36:50.754171 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 479/959] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:50 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:50.802868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-dc0b51bf-05e6-4d91-b8d5-ccaaa405998f req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "name": "network-vif-deleted", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:50.806267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:50.806267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:36:50.820278 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-dc0b51bf-05e6-4d91-b8d5-ccaaa405998f req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:50.821300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-dc0b51bf-05e6-4d91-b8d5-ccaaa405998f req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:50.837664 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-dc0b51bf-05e6-4d91-b8d5-ccaaa405998f req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 service nova] Creating event network-vif-deleted:d9ecab87-157e-4ccb-8423-2248bb8451ea for instance c7fa09fb-ae2b-4479-8848-f142131fe33a on hv-cinder-81977 Dec 08 11:36:50.844163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-dc0b51bf-05e6-4d91-b8d5-ccaaa405998f req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045973 Dec 08 11:36:50.846628 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 481/960] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:36:51.017021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:51.017683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:51.023449 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.023907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.024682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.025118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.112056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lazy-loading 'services' on Instance uuid 87e72067-7d43-45ee-9f67-e4a72419ea29 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:51.136298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:51.138318 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:51.148742 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.149450 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.150838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.151468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.192233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.192989 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.193565 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lazy-loading 'fault' on Instance uuid c7fa09fb-ae2b-4479-8848-f142131fe33a {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:36:51.198964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dcfb6d34-3759-44e1-be12-bbebdebeee91 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "DELETE /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29/os-volume_attachments/742f4b40-b7d3-48de-b15e-ce168f3e115c" status: 202 len: 0 microversion: 2.1 time: 0.185716 Dec 08 11:36:51.202882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 480/961] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:36:51 2021] DELETE /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29/os-volume_attachments/742f4b40-b7d3-48de-b15e-ce168f3e115c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:36:51.268916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d93916bc3fd40fb8f60f9b7a592a29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e91fcdeaf64d10965b2770cbeab690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:51.271139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-30e4a897-100e-44dd-b4b4-835070cfab61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 200 len: 1307 microversion: 2.1 time: 0.139958 Dec 08 11:36:51.273217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 482/962] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:51 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:36:51.772437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:51.773136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:51.779347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.780064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.781000 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:51.781489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:51.930350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:51.938527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1755 microversion: 2.1 time: 0.170659 Dec 08 11:36:51.939493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 481/963] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:51 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:52.289435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:52.290682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] [instance: c7fa09fb-ae2b-4479-8848-f142131fe33a] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:52.304405 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:52.305802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:52.306609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:52.307049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:52.343999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] HTTP exception thrown: Instance c7fa09fb-ae2b-4479-8848-f142131fe33a could not be found. Dec 08 11:36:52.346856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Returning 404 to user: Instance c7fa09fb-ae2b-4479-8848-f142131fe33a could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:52.347810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3c1eb99b-de60-444f-aea3-aa3a5da00b28 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a" status: 404 len: 111 microversion: 2.1 time: 0.063922 Dec 08 11:36:52.348858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 483/964] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:52 2021] GET /compute/v2.1/servers/c7fa09fb-ae2b-4479-8848-f142131fe33a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:36:52.956636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:52.957076 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:52.963124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:52.963766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:52.964717 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:52.965163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:53.140181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:53.150350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1758 microversion: 2.1 time: 0.198181 Dec 08 11:36:53.151572 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 482/965] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:52 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:53.406034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:53.406525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:53.414004 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:53.414702 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:53.415500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:53.415958 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:53.441460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:36:53.529579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "DELETE /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 204 len: 0 microversion: 2.1 time: 0.126748 Dec 08 11:36:53.533749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 484/966] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:36:53 2021] DELETE /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:36:53.538971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:53.539792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:53.548090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:53.548597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:53.550070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:53.552132 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:53.694910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:53.702604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b853e13a-fced-47e6-92be-14f933a69b7b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1515 microversion: 2.1 time: 0.167539 Dec 08 11:36:53.703600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 483/967] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:53 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:54.724128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:54.724984 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:54.732079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:54.732537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:54.733367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:54.733805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:54.890073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:54.898204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-64f771a4-7750-4307-9c94-8ccf7478dddd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1515 microversion: 2.1 time: 0.178586 Dec 08 11:36:54.898836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 485/968] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:54 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:55.914992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:55.915611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:55.931950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:55.932411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:55.933235 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:55.933678 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:56.212511 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f278a968674782b818bb4e83572402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b41ae149164acbb31b021c9049b500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:36:56.221371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-26249ade-959f-488c-b0f1-9d306fded333 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 200 len: 1515 microversion: 2.1 time: 0.309815 Dec 08 11:36:56.231961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 484/969] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:55 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:36:56.450215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-663a0527-0c07-4a2f-95e4-24c11d951951 req-53a6bf34-d150-4040-9efa-1a2d55e0d028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "name": "network-vif-deleted", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:36:56.451738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:36:56.451738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:36:56.459187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-663a0527-0c07-4a2f-95e4-24c11d951951 req-53a6bf34-d150-4040-9efa-1a2d55e0d028 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:56.459669 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-663a0527-0c07-4a2f-95e4-24c11d951951 req-53a6bf34-d150-4040-9efa-1a2d55e0d028 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:56.472543 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-663a0527-0c07-4a2f-95e4-24c11d951951 req-53a6bf34-d150-4040-9efa-1a2d55e0d028 service nova] Creating event network-vif-deleted:a6ac8770-1fec-45c1-8b57-a96317ee73ed for instance 87e72067-7d43-45ee-9f67-e4a72419ea29 on hv-cinder-81977 Dec 08 11:36:56.477335 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-663a0527-0c07-4a2f-95e4-24c11d951951 req-53a6bf34-d150-4040-9efa-1a2d55e0d028 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030699 Dec 08 11:36:56.477935 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 486/970] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:36:57.239538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:36:57.240364 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] [instance: 87e72067-7d43-45ee-9f67-e4a72419ea29] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:36:57.247104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:57.247726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:57.248778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:36:57.249338 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:36:57.264772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] HTTP exception thrown: Instance 87e72067-7d43-45ee-9f67-e4a72419ea29 could not be found. Dec 08 11:36:57.265827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Returning 404 to user: Instance 87e72067-7d43-45ee-9f67-e4a72419ea29 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:36:57.267781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7e1c8be4-7656-4aa0-9085-b52e875df357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29" status: 404 len: 111 microversion: 2.1 time: 0.032318 Dec 08 11:36:57.268426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 485/971] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:36:57 2021] GET /compute/v2.1/servers/87e72067-7d43-45ee-9f67-e4a72419ea29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:37:14.222134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:37:14.222557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:37:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:37:34.708857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:34.709483 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:34.715530 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:34.715986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:34.716767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:34.717242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:34.796319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lazy-loading 'services' on Instance uuid 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:37:34.862634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ebc4906e-4bf6-4187-be91-f188ed0b5e0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-volume_attachments/d530645a-3422-4f8e-b2a6-22eafb01384e" status: 202 len: 0 microversion: 2.1 time: 0.315743 Dec 08 11:37:34.863231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 487/972] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:37:34 2021] DELETE /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-volume_attachments/d530645a-3422-4f8e-b2a6-22eafb01384e => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:37:49.693031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-288c4ce4-b2bb-4535-b921-0266acd0ff39 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:37:49.700180 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-288c4ce4-b2bb-4535-b921-0266acd0ff39 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:49.700558 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-288c4ce4-b2bb-4535-b921-0266acd0ff39 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:49.724690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-288c4ce4-b2bb-4535-b921-0266acd0ff39 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Going to try to stop instance {{(pid=117270) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 08 11:37:49.764646 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-288c4ce4-b2bb-4535-b921-0266acd0ff39 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 202 len: 0 microversion: 2.1 time: 0.075405 Dec 08 11:37:49.765258 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 486/973] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:37:49 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:37:49.775083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:49.775857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:49.784487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:49.785036 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:49.786027 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:49.786471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:49.917323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:49.924625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6c7ee474-581d-4bda-8b96-d20c7e29c757 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.154562 Dec 08 11:37:49.925203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 488/974] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:49 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:50.943174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:50.944287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:50.953293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:50.953850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:50.955209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:50.955537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:51.144846 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:51.152018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:37:51.152552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:37:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:37:51.152655 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6bc90771-c0ca-4001-aa6b-78f92496e60e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.213947 Dec 08 11:37:51.153135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 487/975] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:50 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:52.169985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:52.170589 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:52.176981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:52.177457 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:52.178229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:52.178663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:52.313827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:52.322269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.156033 Dec 08 11:37:52.322852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 489/976] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:52 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:53.339255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:53.339894 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:53.346127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:53.346572 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:53.347347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:53.347777 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:53.477223 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:53.484415 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-acec5719-f461-4ea4-a0a7-d56685bac861 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.148806 Dec 08 11:37:53.484976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 488/977] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:53 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:54.501838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:54.502452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:54.509350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:54.509804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:54.510589 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:54.511028 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:54.637728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:54.645251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-77da3690-e173-40a1-94e9-31b36cd7c3c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.147059 Dec 08 11:37:54.645809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 490/978] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:54 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:55.662690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:55.663850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:55.670140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:55.670592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:55.671372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:55.671808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:55.803079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:55.810991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3b900271-58bc-4ef3-8055-e801f10edabe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.152311 Dec 08 11:37:55.811539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 489/979] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:55 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:37:56.827790 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:56.828486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:56.835435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:56.835966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:56.836847 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:56.837512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:56.968002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:56.976402 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3c43fc36-b50a-42c1-966e-cd2c67688144 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.152149 Dec 08 11:37:56.976966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 491/980] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:56 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:57.828129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:37:57.828647 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:37:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:37:57.993810 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:57.994418 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:58.000691 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:58.001143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:58.001957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:58.002398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:58.128949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:58.136234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9398a3b3-4c1f-4047-893b-d48d3e65e564 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.146520 Dec 08 11:37:58.136787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 490/981] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:57 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:37:59.153266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:37:59.153820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:37:59.160083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:59.160542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:59.161361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:37:59.161806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:37:59.292391 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:37:59.299632 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.150161 Dec 08 11:37:59.300190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 492/982] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:37:59 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:00.317070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:00.317624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:00.324340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:00.324791 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:00.325643 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:00.326083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:00.465234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:00.472406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-be98ee27-0b52-4302-9179-5e153698fa04 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.159098 Dec 08 11:38:00.472959 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 491/983] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:00 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:01.488886 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:01.489444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:01.496115 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:01.496566 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:01.497385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:01.497835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:01.628728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:01.636106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.150962 Dec 08 11:38:01.636793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 493/984] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:01 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:02.653542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:02.654073 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:02.660329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:02.660775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:02.661642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:02.662075 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:02.791215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:02.798437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.148573 Dec 08 11:38:02.798980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 492/985] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:02 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:03.815390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:03.815994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:03.822398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:03.822848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:03.823621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:03.824055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:03.949731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:03.956894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a38cfe95-9191-4438-aac7-ec05fca9cb22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.145087 Dec 08 11:38:03.957486 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 494/986] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:03 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:04.972604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:04.973334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:04.979834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:04.980354 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:04.981136 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:04.981596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:05.115816 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:05.123480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.154339 Dec 08 11:38:05.124128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 493/987] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:04 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:06.139508 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:06.140371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:06.146654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:06.147106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:06.147889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:06.148336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:06.276474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:06.283655 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4fc3220a-67e0-44ba-855e-ef23eefde602 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.147794 Dec 08 11:38:06.284213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 495/988] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:06 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:07.300720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:07.301379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:07.307858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:07.308311 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:07.309114 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:07.309570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:07.437515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:07.445737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2e8faba4-9950-45bf-83fd-5059f98b4932 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.148607 Dec 08 11:38:07.446293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 494/989] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:07 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:08.465819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:08.466437 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:08.472630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:08.473083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:08.473905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:08.474346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:08.656801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:08.664865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-35e313f2-a1e8-428b-a345-61296740356d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.202720 Dec 08 11:38:08.665472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 496/990] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:08 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:09.681883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:09.682497 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:09.688608 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:09.689063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:09.689904 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:09.690376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:09.826450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:09.833775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-45ae71a4-25ae-444f-b3a7-01e83796c33c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.156020 Dec 08 11:38:09.834339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 495/991] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:09 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:10.851175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:10.851902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:10.858791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:10.859329 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:10.860342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:10.860791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:10.989858 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:10.997175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-12091296-e0d0-4774-a82c-92f1bab143e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.150172 Dec 08 11:38:10.997766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 497/992] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:10 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:12.013522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:12.014128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:12.020466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:12.020913 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:12.022236 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:12.022657 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:12.163947 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:12.172596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c9a7f62c-f677-473c-ab43-7f091d83239c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.162561 Dec 08 11:38:12.183233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 496/993] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:12 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:13.188889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:13.189522 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:13.196356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:13.196808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:13.197613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:13.198051 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:13.328497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:13.336290 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2b08181e-f512-4130-8caf-afca7eb1bdfb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.150966 Dec 08 11:38:13.336792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 498/994] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:13 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:14.353690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:14.354235 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:14.360553 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:14.361002 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:14.361907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:14.362352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:14.488847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:14.496694 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-44a8bd9f-097b-47f1-8132-28d71001d4f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.147274 Dec 08 11:38:14.497335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 497/995] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:14 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:15.513551 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:15.514165 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:15.520658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:15.521114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:15.522438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:15.522880 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:15.654682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:15.662147 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.152196 Dec 08 11:38:15.663818 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 499/996] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:15 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:16.681055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:16.681711 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:16.688002 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:16.688448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:16.689259 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:16.689698 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:16.817579 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:16.825399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6473f654-ccb0-4ff4-91c2-c74008827095 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1677 microversion: 2.1 time: 0.148604 Dec 08 11:38:16.825963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 498/997] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:16 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:17.842820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:17.843434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:17.849746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:17.850673 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:17.851453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:17.851891 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:18.065023 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:18.074631 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-20703ade-b06f-4047-aace-9a335afdd163 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1654 microversion: 2.1 time: 0.235418 Dec 08 11:38:18.075211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 500/998] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:17 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1654 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:18.092319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:18.098195 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:18.098664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:18.120671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Going to try to start instance {{(pid=117270) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 08 11:38:18.162842 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action" status: 202 len: 0 microversion: 2.1 time: 0.074838 Dec 08 11:38:18.163440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 499/999] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:38:18 2021] POST /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:38:18.171426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:18.172124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:18.178134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:18.178715 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:18.179744 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:18.180372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:18.452905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:18.460309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1663 microversion: 2.1 time: 0.292628 Dec 08 11:38:18.460883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 501/1000] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:18 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1663 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:19.478152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:19.478850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:19.484759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:19.485246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:19.486029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:19.486469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:19.623223 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:19.630630 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1ca88ecd-5f76-4fee-b670-38e0615fe977 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1667 microversion: 2.1 time: 0.157546 Dec 08 11:38:19.631437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 500/1001] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:19 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:26.824848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2138933485"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:26.825505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:26.832781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:26.833633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:26.834683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:26.835134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:26.974025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.network.security_group_api [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Removing security group 7c872497-d719-4618-a000-bf3059a98a01 from port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec Dec 08 11:38:27.333214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/action" status: 202 len: 0 microversion: 2.1 time: 0.679825 Dec 08 11:38:27.333884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 502/1002] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:38:26 2021] POST /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:38:27.361610 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-becbe910-d017-4078-a520-629a3bb2295f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:27.363852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:38:27.363852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:38:27.374095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-180352f3-8678-4a77-81d3-861e98719559 req-becbe910-d017-4078-a520-629a3bb2295f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:27.374807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-180352f3-8678-4a77-81d3-861e98719559 req-becbe910-d017-4078-a520-629a3bb2295f service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:27.395389 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-180352f3-8678-4a77-81d3-861e98719559 req-becbe910-d017-4078-a520-629a3bb2295f service nova] Creating event network-changed:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:38:27.429860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-180352f3-8678-4a77-81d3-861e98719559 req-becbe910-d017-4078-a520-629a3bb2295f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071408 Dec 08 11:38:27.431227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 501/1003] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:38:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:29.006114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:29.006632 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:29.012855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:29.013406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:29.014268 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:29.015048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:29.093594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lazy-loading 'services' on Instance uuid c83efb85-fcf2-457d-9941-03898d0dccfd {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:38:29.163139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6cda982c-4997-43f5-8faa-8b35e781e4c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments/f2873984-c057-4042-b9ac-c762a051ee04" status: 202 len: 0 microversion: 2.1 time: 0.161602 Dec 08 11:38:29.164311 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 503/1004] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:38:29 2021] DELETE /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments/f2873984-c057-4042-b9ac-c762a051ee04 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:38:29.172919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:29.174636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:29.182267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:29.182986 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:29.183974 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:29.184584 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:29.214255 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-917459e7-de3e-4e0a-9004-e4cdd675acfb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Dec 08 11:38:29.214853 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 502/1005] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:38:29 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:29.444733 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:29.446793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:38:29.446793 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:38:29.453817 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-ed9377c2-ea52-45aa-a755-d316380be933 req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:29.454261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-ed9377c2-ea52-45aa-a755-d316380be933 req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:29.465324 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-ed9377c2-ea52-45aa-a755-d316380be933 req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab service nova] Creating event network-changed:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:38:29.470174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-ed9377c2-ea52-45aa-a755-d316380be933 req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029317 Dec 08 11:38:29.470747 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 504/1006] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:38:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:30.225855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:30.227179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:30.233693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:30.234141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:30.234916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:30.235348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:30.263059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c7c0a36c-75d5-4a1e-8e5f-27f864a3d0f6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041368 Dec 08 11:38:30.263590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 503/1007] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:38:30 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:31.276263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:31.277310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:31.283339 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:31.283795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:31.284555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:31.284987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:31.312472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f91775c5-1625-4f1b-aaad-0aa042463a7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041284 Dec 08 11:38:31.313014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 505/1008] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:38:31 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:32.323804 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:32.324722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:32.330925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:32.331382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:32.332158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:32.332596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:32.360482 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b54212a9-7d7f-42fc-b498-d26ec1d384e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040380 Dec 08 11:38:32.360936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 504/1009] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:38:32 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:33.372440 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:33.373309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:33.379478 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:33.379928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:33.380701 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:33.381141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:33.409132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ca6fd41e-47a2-4b44-97ff-17dc9d1af809 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040561 Dec 08 11:38:33.409690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 506/1010] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:38:33 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:34.419766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:34.420683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:34.427090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.427539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.428314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.428747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.456924 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-11cde6d6-ed7d-469d-976f-2269e91b79c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040979 Dec 08 11:38:34.457496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 505/1011] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:38:34 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:38:34.467049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:34.467532 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:34.473729 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.474184 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.474972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.475411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.545177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] HTTP exception thrown: Instance c83efb85-fcf2-457d-9941-03898d0dccfd is not attached to volume f2873984-c057-4042-b9ac-c762a051ee04 Dec 08 11:38:34.545846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Returning 404 to user: Instance c83efb85-fcf2-457d-9941-03898d0dccfd is not attached to volume f2873984-c057-4042-b9ac-c762a051ee04 {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:38:34.546687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-584815b9-9360-4ceb-ac77-b06e229a8016 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments/f2873984-c057-4042-b9ac-c762a051ee04" status: 404 len: 154 microversion: 2.1 time: 0.083499 Dec 08 11:38:34.547237 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 507/1012] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:38:34 2021] DELETE /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd/os-volume_attachments/f2873984-c057-4042-b9ac-c762a051ee04 => generated 154 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:38:34.692411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:34.692837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:34.698636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.699088 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.699865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.700300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.731848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5c77da21-6db2-464a-94b6-3cbc15ec74b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments/77427cad-21cb-4528-bf76-3b754f6ef115" status: 200 len: 194 microversion: 2.20 time: 0.043298 Dec 08 11:38:34.732434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 506/1013] 10.222.0.66 () {60 vars in 1453 bytes} [Wed Dec 8 11:38:34 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments/77427cad-21cb-4528-bf76-3b754f6ef115 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:38:34.792243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:34.792730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:34.798403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.798852 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.799622 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.800060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.879427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lazy-loading 'services' on Instance uuid 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:38:34.958459 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cf471f64-1ce1-44a1-882d-fc8f24fa895f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments/77427cad-21cb-4528-bf76-3b754f6ef115" status: 202 len: 0 microversion: 2.20 time: 0.170200 Dec 08 11:38:34.959101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 508/1014] 10.222.0.66 () {60 vars in 1456 bytes} [Wed Dec 8 11:38:34 2021] DELETE /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments/77427cad-21cb-4528-bf76-3b754f6ef115 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:38:34.967924 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:34.968840 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:34.975305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.975807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:34.977503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:34.977924 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:35.011097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-091c0f55-087e-4d53-a709-cbde1a67440d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046938 Dec 08 11:38:35.011768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 507/1015] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Dec 8 11:38:34 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:38:35.673774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:35.674400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:35.680520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:35.680983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:35.681885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:35.682340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:35.707509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:38:35.783619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c4517de2-c682-4b20-8fba-0f184cb0808e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 204 len: 0 microversion: 2.1 time: 0.114045 Dec 08 11:38:35.785111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 509/1016] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:38:35 2021] DELETE /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:38:35.793638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:35.794440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:35.802306 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:35.802793 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:35.803588 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:35.804056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:35.936021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:35.943212 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1553 microversion: 2.1 time: 0.153194 Dec 08 11:38:35.943765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 508/1017] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:35 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:36.023980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:36.025067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:36.031006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.031464 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.032250 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.032692 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.060416 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-927eabc6-a180-4e58-a23e-d8e28632bf90 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041199 Dec 08 11:38:36.060970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 510/1018] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Dec 8 11:38:36 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:36.128200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:36.128696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:36.135064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.135538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.136370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.136756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.161431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:38:36.236256 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-48286d32-42cb-4691-8b9a-65fbe5b5d25a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 204 len: 0 microversion: 2.20 time: 0.111346 Dec 08 11:38:36.236978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 509/1019] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Dec 8 11:38:36 2021] DELETE /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 08 11:38:36.246870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:36.246870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:36.252738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.253273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.254029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.254469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.400018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:36.411616 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:36.413122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:36.414315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.173054 Dec 08 11:38:36.414863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 511/1020] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:36 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:36.960858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:36.961664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:36.967988 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.968448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:36.969269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:36.969718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:37.185269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101fe00a724249e4bf2d3c98224142f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:37.193399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 200 len: 1553 microversion: 2.1 time: 0.237139 Dec 08 11:38:37.193968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 510/1021] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:36 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:38:37.432397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:37.433625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:37.441955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:37.442713 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:37.443522 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:37.444124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:37.495353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-7d77ba58-c7ac-49fa-a1a0-19974a0dc810 req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "name": "network-vif-deleted", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:37.497680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:38:37.497680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:38:37.511854 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-7d77ba58-c7ac-49fa-a1a0-19974a0dc810 req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:37.512342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-7d77ba58-c7ac-49fa-a1a0-19974a0dc810 req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:37.529194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-7d77ba58-c7ac-49fa-a1a0-19974a0dc810 req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b service nova] Creating event network-vif-deleted:7fe8b63d-f6cd-45dc-a53c-93b64cacfeec for instance c83efb85-fcf2-457d-9941-03898d0dccfd on hv-cinder-81977 Dec 08 11:38:37.534731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-7d77ba58-c7ac-49fa-a1a0-19974a0dc810 req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044479 Dec 08 11:38:37.535352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 511/1022] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:37.611786 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:37.621390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:37.623059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:37.624809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.196878 Dec 08 11:38:37.625473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 512/1023] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:37 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:38.216201 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:38.217831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] [instance: c83efb85-fcf2-457d-9941-03898d0dccfd] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:38.228231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:38.228996 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:38.230040 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:38.231351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:38.247267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] HTTP exception thrown: Instance c83efb85-fcf2-457d-9941-03898d0dccfd could not be found. Dec 08 11:38:38.248270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Returning 404 to user: Instance c83efb85-fcf2-457d-9941-03898d0dccfd could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:38:38.249345 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0cb03fbd-531a-4f83-b9de-f6d1b93461e5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd" status: 404 len: 111 microversion: 2.1 time: 0.040783 Dec 08 11:38:38.250193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 512/1024] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:38 2021] GET /compute/v2.1/servers/c83efb85-fcf2-457d-9941-03898d0dccfd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:38:38.259549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-523be8b0-851b-4b4c-9bab-41b3a56561a9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling method '.version_select at 0x7f1fa64ee820>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:38.286117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-523be8b0-851b-4b4c-9bab-41b3a56561a9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-962986123" status: 202 len: 0 microversion: 2.1 time: 0.031680 Dec 08 11:38:38.287658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 513/1025] 10.222.0.66 () {58 vars in 1268 bytes} [Wed Dec 8 11:38:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-962986123 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:38:38.643808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:38.644654 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:38.654470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:38.655175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:38.656162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:38.656765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:39.029820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:39.048749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:39.055665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:39.058224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-25f1c725-75f0-4774-9071-b1b911430ead tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1720 microversion: 2.20 time: 0.418613 Dec 08 11:38:39.059828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 513/1026] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:38 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1720 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:39.844477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-73290c0b-cc2b-4274-a7b4-643d3520de12 req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-deleted", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:39.846936 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:38:39.846936 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:38:39.857218 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-73290c0b-cc2b-4274-a7b4-643d3520de12 req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:39.857829 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-73290c0b-cc2b-4274-a7b4-643d3520de12 req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:39.870120 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-73290c0b-cc2b-4274-a7b4-643d3520de12 req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 service nova] Creating event network-vif-deleted:2ebdbac7-6fba-4bd2-bbec-7e49216db3fe for instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f on hv-cinder-81977 Dec 08 11:38:39.875512 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-73290c0b-cc2b-4274-a7b4-643d3520de12 req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035655 Dec 08 11:38:39.879599 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 514/1027] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:38:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:40.087507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:40.095433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:40.101884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:40.102574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:40.103554 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:40.104154 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:40.143068 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:40.143782 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:40.144396 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lazy-loading 'fault' on Instance uuid 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:38:40.187444 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:40.199114 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:40.201857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:40.204472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 200 len: 1368 microversion: 2.20 time: 0.124592 Dec 08 11:38:40.204472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 514/1028] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:40 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 1368 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:41.224277 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:41.224987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:41.234683 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:41.236229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:41.237389 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:41.238022 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:41.263605 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] HTTP exception thrown: Instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f could not be found. Dec 08 11:38:41.264952 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Returning 404 to user: Instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:38:41.266201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d82dfd1c-635c-43d9-b968-0a1a227577ea tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 404 len: 111 microversion: 2.20 time: 0.048010 Dec 08 11:38:41.267521 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 515/1029] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:41 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 08 11:38:41.275973 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-90062d59-f336-4235-b80f-ffb05ae63970 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '.version_select at 0x7f1fa68348b0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:41.320311 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-90062d59-f336-4235-b80f-ffb05ae63970 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7215352" status: 204 len: 0 microversion: 2.20 time: 0.047950 Dec 08 11:38:41.324454 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 515/1030] 10.222.0.66 () {60 vars in 1252 bytes} [Wed Dec 8 11:38:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7215352 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 08 11:38:42.201977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-93ed6281-42b6-42d2-9328-ab17d1d50f38 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'create', calling method: .version_select at 0x7f1fa65600d0>, body: {"keypair": {"name": "tempest-keypair-1005935368"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:42.216819 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-93ed6281-42b6-42d2-9328-ab17d1d50f38 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:38:42.220810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-93ed6281-42b6-42d2-9328-ab17d1d50f38 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for user c73027d527c3484985868045e24272e9 and project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:38:42.425018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-93ed6281-42b6-42d2-9328-ab17d1d50f38 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:38:42.432286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-93ed6281-42b6-42d2-9328-ab17d1d50f38 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for user c73027d527c3484985868045e24272e9 and project 44406e332fd94f1a9dcd704577410a61. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:38:42.445635 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-93ed6281-42b6-42d2-9328-ab17d1d50f38 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.249674 Dec 08 11:38:42.446368 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 516/1031] 10.222.0.66 () {62 vars in 1198 bytes} [Wed Dec 8 11:38:42 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 08 11:38:44.386577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1176410598", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd37a1fc-3614-462b-92a2-b41260c949a2"}], "security_groups": [{"name": "tempest-securitygroup--1572057722"}], "key_name": "tempest-keypair-1005935368", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:44.525234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] validate_networks() for [('fd37a1fc-3614-462b-92a2-b41260c949a2', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:38:45.282337 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:38:45.282770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:38:45.283245 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:38:45.283656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:38:45.284070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:38:45.293097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:45.293585 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:45.294428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:45.294865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:45.311219 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for project 44406e332fd94f1a9dcd704577410a61. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:38:45.315111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Getting quotas for user c73027d527c3484985868045e24272e9 and project 44406e332fd94f1a9dcd704577410a61. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:38:45.325693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:38:45.327999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:38:45.372924 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.991649 Dec 08 11:38:45.373850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 516/1032] 10.222.0.66 () {62 vars in 1187 bytes} [Wed Dec 8 11:38:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 08 11:38:45.385853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:45.387424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:45.724692 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:45.734529 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:45.736382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:45.737698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1282 microversion: 2.20 time: 0.357124 Dec 08 11:38:45.738467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 517/1033] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:45 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1282 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:46.756192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:46.761834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:46.769489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:46.770248 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:46.771443 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:46.772084 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:46.857395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:46.865656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:46.868021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:46.869140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1334 microversion: 2.20 time: 0.117363 Dec 08 11:38:46.869720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 517/1034] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:46 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:47.887510 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:47.888126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:47.894732 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:47.895191 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:47.896044 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:47.896421 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:47.963148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:47.970801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:47.972312 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:47.973441 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4bfbec35-85a7-4305-8e82-19856945ff00 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1334 microversion: 2.20 time: 0.089710 Dec 08 11:38:47.973999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 518/1035] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:47 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:48.991411 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:48.992023 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:48.998595 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:48.999148 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:48.999940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:49.000446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:49.060299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:49.068001 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:49.070083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:49.071164 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9394d55b-1731-449c-8060-11b77dffd6fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1342 microversion: 2.20 time: 0.083436 Dec 08 11:38:49.071715 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 518/1036] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:48 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:50.089571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:50.090319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:50.097074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:50.097700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:50.098603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:50.099150 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:50.174134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:50.182619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:50.184135 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:50.185319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5240aea7-590c-469f-8674-b9ae186b8e42 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1352 microversion: 2.20 time: 0.100013 Dec 08 11:38:50.186112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 519/1037] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:50 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:51.206175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:51.207361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:51.214556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:51.215442 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:51.216963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:51.217635 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:51.435796 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:51.446479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:51.455087 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:51.456387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2f866304-fa9b-4b13-9c6d-b82e249af628 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.255007 Dec 08 11:38:51.456850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 519/1038] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:51 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:51.725763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-03ec281a-fe0b-4021-9436-b1e28837f4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:51.727559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:38:51.727559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:38:51.745961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-03ec281a-fe0b-4021-9436-b1e28837f4a9 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:51.746388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-03ec281a-fe0b-4021-9436-b1e28837f4a9 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:51.758949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-03ec281a-fe0b-4021-9436-b1e28837f4a9 service nova] Creating event network-changed:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:38:51.763890 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-03ec281a-fe0b-4021-9436-b1e28837f4a9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048585 Dec 08 11:38:51.764954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 520/1039] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:52.474246 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:52.474858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:52.481943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:52.482396 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:52.484466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:52.484466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:52.716955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:52.724528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:52.726070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:52.727158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-69d20e21-703f-4f77-939e-5cbb8edfca05 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.256656 Dec 08 11:38:52.727689 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 520/1040] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:52 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:53.744623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:53.745348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:53.751419 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:53.751875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:53.752656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:53.753098 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:53.881586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:53.889229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:53.891117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:53.892214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.152171 Dec 08 11:38:53.892759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 521/1041] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:53 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:54.909083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:54.909814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:54.916459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:54.916905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:54.917705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:54.918146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:55.043322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:55.050881 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:55.052350 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:55.053457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5aa9ff16-7831-4ab7-acac-1203e4301b0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.148148 Dec 08 11:38:55.054008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 521/1042] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:54 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:56.070594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:56.071139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:56.077643 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:56.078100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:56.078895 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:56.079329 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:56.207266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:56.215496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:56.217001 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:56.218141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.151359 Dec 08 11:38:56.218702 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 522/1043] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:56 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:57.235521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:57.236123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:57.243117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:57.243563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:57.244368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:57.244801 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:57.373433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:57.381044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:57.382563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:57.383656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6ef028da-a7d2-4b51-8146-dc28a108b32b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.151799 Dec 08 11:38:57.384199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 522/1044] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:57 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:58.031531 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-2e4e6419-22d0-418f-bed2-f60f35478f98 req-629687a3-42a3-4026-b305-e7bd834407e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:58.033016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:38:58.033016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:38:58.040207 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-2e4e6419-22d0-418f-bed2-f60f35478f98 req-629687a3-42a3-4026-b305-e7bd834407e6 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:58.040670 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-2e4e6419-22d0-418f-bed2-f60f35478f98 req-629687a3-42a3-4026-b305-e7bd834407e6 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:58.050927 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-2e4e6419-22d0-418f-bed2-f60f35478f98 req-629687a3-42a3-4026-b305-e7bd834407e6 service nova] Creating event network-vif-plugged:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:38:58.056761 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-2e4e6419-22d0-418f-bed2-f60f35478f98 req-629687a3-42a3-4026-b305-e7bd834407e6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198444 Dec 08 11:38:58.057411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 523/1045] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:38:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:38:58.401809 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:58.402419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:58.408750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:58.409238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:58.410025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:58.410460 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:58.541999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:58.549582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:58.551077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:58.552170 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0e11bbd0-5808-4610-8abd-0fb22b607f80 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.154053 Dec 08 11:38:58.552886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 523/1046] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:58 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:59.572061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:59.572766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:59.579919 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:59.580377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:59.581178 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:59.581645 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:59.715855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:59.724121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:59.725632 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:38:59.727298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-471310f3-eab1-4fe1-82c3-ae34209eacff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1408 microversion: 2.20 time: 0.160698 Dec 08 11:38:59.727844 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 524/1047] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:38:59 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:38:59.828125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:38:59.828655 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:59.834509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:59.834949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:59.835949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:59.836400 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:59.858926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lazy-loading 'flavor' on Instance uuid 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:38:59.926765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5506cebd-f0a4-467d-964c-e95c70349128 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.204140 Dec 08 11:38:59.927339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 524/1048] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:38:59 2021] POST /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:38:59.935753 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:38:59.936395 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:38:59.942118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:59.942571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:38:59.943357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:38:59.943795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:00.073063 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:00.080415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c4a9988d-2935-41ab-ad47-4448b6063461 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.148322 Dec 08 11:39:00.080980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 525/1049] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:38:59 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:00.745956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:00.746570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:00.752618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:00.753067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:00.753875 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:00.754315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:00.886532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:00.894434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:00.895925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:00.897066 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-158c1022-297f-44de-b109-a4dba25208d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1600 microversion: 2.20 time: 0.155827 Dec 08 11:39:00.897641 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 525/1050] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:39:00 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:39:00.914850 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:00.915348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:00.921584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:00.922044 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:00.923185 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:00.923634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:01.000043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-28ac1200-b27e-48f7-9f32-d8603d18d639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088834 Dec 08 11:39:01.000630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 526/1051] 10.222.0.66 () {60 vars in 1315 bytes} [Wed Dec 8 11:39:00 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:39:01.097704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:01.098309 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:01.104181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:01.104628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:01.105433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:01.105872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:01.617438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:01.624640 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f59a7743-c062-42a5-92a7-74eb157d8364 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.530568 Dec 08 11:39:01.625213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 526/1052] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:01 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:02.240000 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:02.241382 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:02.241803 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:02.243388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:02.243388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:39:02.247587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:02.248112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:02.248968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:02.249507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:02.250435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a771d047-a413-43fc-9189-6e473848762a req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:02.250885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a771d047-a413-43fc-9189-6e473848762a req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:02.262356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-a771d047-a413-43fc-9189-6e473848762a req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad service nova] Creating event network-changed:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:39:02.268033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-a771d047-a413-43fc-9189-6e473848762a req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029802 Dec 08 11:39:02.269017 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 527/1053] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:39:02.314367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-49971111-b665-40b5-92ab-1e72648faf28 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.078335 Dec 08 11:39:02.317775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 527/1054] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:02 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:02.642204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:02.642983 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:02.649243 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:02.649696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:02.650470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:02.650901 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:02.863846 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:02.871861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.233872 Dec 08 11:39:02.872424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 528/1055] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:02 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:03.326058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:03.328390 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:03.338130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:03.338873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:03.340196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:03.340957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:03.416706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aa5b9cca-04b4-4ca1-84e3-38e0af51fab1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.094877 Dec 08 11:39:03.417339 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 528/1056] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:03 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:03.889598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:03.890232 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:03.896468 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:03.896916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:03.897719 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:03.898753 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:04.026940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:04.034157 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.148467 Dec 08 11:39:04.034704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 529/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:03 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:04.428026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:04.429073 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:04.436435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:04.436887 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:04.437693 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:04.438137 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:04.494943 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-98cbb6b0-0196-47dc-9dd1-24f84adfe19c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.070721 Dec 08 11:39:04.495503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 529/1058] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:04 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:05.050373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:05.051014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:05.057826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:05.058273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:05.059057 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:05.059489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:05.194240 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:05.202205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-22fc5292-74b4-4a90-9be2-e7c82090213a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.155467 Dec 08 11:39:05.202764 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 530/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:05 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:05.509095 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:05.510162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:05.517343 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:05.517804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:05.518602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:05.519048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:05.594031 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b3969851-91f9-4809-ae2a-b09d5fcaea25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.090244 Dec 08 11:39:05.594785 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 530/1060] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:05 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:06.219857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:06.220462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:06.227231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:06.227685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:06.228490 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:06.228953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:06.357086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:06.364336 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-13173625-fe99-41d8-9bb1-9735e23040ac tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.148188 Dec 08 11:39:06.364896 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 531/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:06 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:06.606002 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:06.606933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:06.613690 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:06.614134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:06.614908 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:06.615341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:06.670332 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c6ad0801-074d-44fa-8eb9-4f1f0b0a19fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.068988 Dec 08 11:39:06.670924 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 531/1062] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:06 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:07.381216 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:07.381834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:07.388758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:07.389499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:07.390299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:07.390747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:07.527419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:07.535470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7469adc5-119d-4a79-8f0f-f522f8c66e4a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.157957 Dec 08 11:39:07.537025 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 532/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:07 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:07.682295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:07.683235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:07.690049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:07.690495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:07.691272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:07.691707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:07.751522 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cb37c5c7-df79-4c2a-a5e6-89c6797e638e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.073909 Dec 08 11:39:07.752292 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 532/1064] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:07 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:08.553178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:08.553822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:08.560666 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:08.561120 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:08.561933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:08.562371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:08.695262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:08.702456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.152961 Dec 08 11:39:08.703012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 533/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:08 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:08.763351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:08.764608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:08.771479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:08.771925 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:08.772700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:08.773135 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:08.830966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8a6c4931-ba58-4ed7-b4bb-919bf6482c56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.071504 Dec 08 11:39:08.831728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 533/1066] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:08 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:09.719732 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:09.720353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:09.726650 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:09.727102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:09.727886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:09.728327 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:09.842865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:09.843902 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:09.850640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:09.851136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:09.851917 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:09.852358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:09.856370 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:09.863688 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.147660 Dec 08 11:39:09.864251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 534/1067] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:09 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:09.915387 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4648b65b-0987-4eda-89a6-cd5bd0f2d822 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.076515 Dec 08 11:39:09.916007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 534/1068] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:09 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:10.879674 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:10.880287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:10.887117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:10.887565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:10.888429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:10.888790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:10.925758 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:10.926763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:10.934082 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:10.934535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:10.935330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:10.935769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:10.995203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f278cd6d-9b03-4b3b-848c-245aee9677dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 14 microversion: 2.20 time: 0.073219 Dec 08 11:39:10.998428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 535/1069] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:10 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:11.021929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:11.029194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.153225 Dec 08 11:39:11.029756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 535/1070] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:10 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:12.006720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:12.008260 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:12.015298 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:12.015746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:12.016519 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:12.016955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:12.046367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:12.046982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:12.053273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:12.053728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:12.054509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:12.054944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:12.087506 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-32f97525-9c2b-41a4-b45f-23c98923c6b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 9976 microversion: 2.20 time: 0.084669 Dec 08 11:39:12.089012 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 536/1071] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:12 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 9976 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:39:12.183142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:12.190879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8e6339e0-5e1d-4277-8360-e17e966be931 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.148227 Dec 08 11:39:12.191441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 536/1072] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:12 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:13.098430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:13.099472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:13.106293 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:13.106743 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:13.108181 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:13.108826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:13.185730 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c1e7bf19-c8a3-4227-b490-44754d861104 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 16503 microversion: 2.20 time: 0.091182 Dec 08 11:39:13.186571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 537/1073] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:13 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 16503 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:13.207489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:13.208214 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:13.215471 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:13.215919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:13.217096 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:13.217690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:13.352010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:13.359303 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d51f234e-6e52-48f3-93ac-a948ab3f38cc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.155493 Dec 08 11:39:13.359855 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 537/1074] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:13 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:14.198341 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:14.199349 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:14.206224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:14.206679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:14.207465 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:14.207909 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:14.278947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-add31e0e-7d33-4d7f-b5a3-bc315479eecb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 18498 microversion: 2.20 time: 0.085189 Dec 08 11:39:14.279558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 538/1075] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:14 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 18498 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:14.376494 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:14.377036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:14.384003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:14.384448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:14.385242 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:14.385676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:14.518493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:14.526562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9b463397-da0b-475b-915a-0adfdaf76b17 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.153839 Dec 08 11:39:14.527128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 538/1076] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:14 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:15.291745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:15.292748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:15.299741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:15.300189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:15.300966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:15.301422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:15.382231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d622c4be-a878-49d5-81b7-f5ab181bca45 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 20997 microversion: 2.20 time: 0.095263 Dec 08 11:39:15.385943 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 539/1077] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:15 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 20997 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:15.543930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:15.544645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:15.551018 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:15.551467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:15.552252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:15.552686 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:15.731519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:15.738859 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-af6929fe-a4eb-490f-80cc-34b29f7173d5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.198624 Dec 08 11:39:15.739424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 539/1078] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:15 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:16.394493 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:16.395409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:16.402705 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:16.403156 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:16.403938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:16.404367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:16.486563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4987b154-9e75-4cd8-a225-c11628259bdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 22895 microversion: 2.20 time: 0.096098 Dec 08 11:39:16.487194 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 540/1079] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:16 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 22895 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:16.755231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:16.755776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:16.761945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:16.762402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:16.763189 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:16.763625 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:16.896679 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:16.904429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.152993 Dec 08 11:39:16.904993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 540/1080] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:16 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:17.497899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:17.498913 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:17.505791 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:17.506246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:17.507584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:17.507991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:17.582978 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9e56baa4-a026-40ab-89f3-17ed1c332d0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 24001 microversion: 2.20 time: 0.089112 Dec 08 11:39:17.584741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 541/1081] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:17 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 24001 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:17.922458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:17.922993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:17.930447 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:17.930893 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:17.931665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:17.932099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.066026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:18.073509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-788b1dac-d52b-4fde-a568-ab8a126784a5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1570 microversion: 2.1 time: 0.155332 Dec 08 11:39:18.074277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 541/1082] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:17 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:18.090695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:18.091364 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:18.098398 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:18.098875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.099666 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:18.100105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.277038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-252e498a-bce6-4941-9080-43c8b9ee5f03 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.190517 Dec 08 11:39:18.278065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 542/1083] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:18 2021] POST /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:18.285916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:18.286731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:18.293286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:18.293738 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.294646 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:18.295190 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.440651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:18.447835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e3779313-e784-4b42-be3c-d47d49cad374 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1518 microversion: 2.1 time: 0.165586 Dec 08 11:39:18.448384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 542/1084] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:18 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:18.595180 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:18.596269 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:18.603454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:18.603905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.604767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:18.605405 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:18.679835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1f5c2c73-6dc5-4054-ace3-6cc8d9d7be13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 25641 microversion: 2.20 time: 0.088646 Dec 08 11:39:18.683668 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 543/1085] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:18 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 25641 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:19.463716 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:19.464305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:19.470668 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:19.471121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:19.471897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:19.472333 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:19.602365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:19.609606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3640bcda-9a20-4731-92db-d559a9badec8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.149488 Dec 08 11:39:19.610165 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 543/1086] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:19 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:19.691873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:19.692884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:19.699942 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:19.700400 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:19.701224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:19.701671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:19.786274 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f512c5ec-0624-4940-aa19-e79e23fdabbc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 26787 microversion: 2.20 time: 0.098241 Dec 08 11:39:19.790633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 544/1087] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:19 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 26787 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:19.907607 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-0b5dac37-db62-4722-a17a-60a9934e650a req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:19.909178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:19.909178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:39:19.917552 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-0b5dac37-db62-4722-a17a-60a9934e650a req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:19.918052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-0b5dac37-db62-4722-a17a-60a9934e650a req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:19.930916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-0b5dac37-db62-4722-a17a-60a9934e650a req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e service nova] Creating event network-vif-unplugged:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:39:19.936015 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-0b5dac37-db62-4722-a17a-60a9934e650a req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032522 Dec 08 11:39:19.936591 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 544/1088] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:39:20.627980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:20.628685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:20.635450 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:20.635904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:20.636680 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:20.637119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:20.777310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:20.784727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b9ba158e-c85a-4400-86ac-65e034fdfb35 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.160732 Dec 08 11:39:20.785321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 545/1089] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:20 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:20.798220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:20.799221 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:20.805719 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:20.806168 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:20.806943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:20.807385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:20.880745 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dcf6f6ed-dcb7-48c4-8880-74181e9d68d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 27650 microversion: 2.20 time: 0.086375 Dec 08 11:39:20.881377 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 545/1090] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:20 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 27650 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:21.802057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:21.802720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:21.808984 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:21.809469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:21.810251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:21.810695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:21.892629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:21.893673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:21.901079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:21.901556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:21.902343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:21.902781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:21.940232 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:21.947583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d65a6521-52f0-475d-9ce8-667e957efa45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.149208 Dec 08 11:39:21.948134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 546/1091] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:21 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:21.983603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1dc03946-3d63-4f71-b0e8-d8982e37eb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 27987 microversion: 2.20 time: 0.095040 Dec 08 11:39:21.984239 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 546/1092] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:21 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 27987 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:22.963397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:22.964038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:22.970357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:22.970810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:22.971589 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:22.972026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:22.995597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:22.996738 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:23.003642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:23.004108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:23.004895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:23.005378 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:23.101407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:23.107658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1b9ad108-8e40-45d5-bf2c-82fc8e4c1070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.116538 Dec 08 11:39:23.108337 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 547/1093] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:22 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:23.109442 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.149717 Dec 08 11:39:23.109998 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 547/1094] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:22 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:24.120044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:24.121061 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:24.126418 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:24.127032 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:24.128046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:24.128498 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:24.129315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:24.129755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:24.133270 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:24.133721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:24.134495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:24.134930 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:24.193966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-72b0351e-a1d7-4a48-8835-81619a5a0b9b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.077698 Dec 08 11:39:24.195041 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 548/1095] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:24 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:24.273681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:24.281275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0e828583-223e-45ee-99de-95a43be68a08 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.158413 Dec 08 11:39:24.282128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 548/1096] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:24 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:25.206064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:25.207097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:25.214492 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:25.214941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:25.215723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:25.216157 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:25.285172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2b554103-af76-45da-a656-6b30d32e5fa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.083019 Dec 08 11:39:25.286156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 549/1097] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:25 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:25.298828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:25.299451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:25.305868 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:25.306320 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:25.307137 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:25.307578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:25.434542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:25.441959 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.146756 Dec 08 11:39:25.442527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 549/1098] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:25 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:26.296264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:26.297282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:26.304615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.305055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.305869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.306298 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.410860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a4b493d1-0042-4736-81e2-d3f3d4fe6a86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.118404 Dec 08 11:39:26.411428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 550/1099] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:26 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:26.458992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:26.459630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:26.465909 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.466360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.467131 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.467563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.597675 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:26.605324 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.149904 Dec 08 11:39:26.605885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 550/1100] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:26 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:26.839882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:26.840882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:26.847594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.848040 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.848817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.849276 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.878756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ff3887b3-06b3-40b9-987a-2e3c4546e4ed tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043326 Dec 08 11:39:26.879294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 551/1101] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:39:26 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:26.933097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:26.933621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:26.939334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.939780 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.940550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:26.940980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:26.966491 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:39:27.040428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 204 len: 0 microversion: 2.1 time: 0.111283 Dec 08 11:39:27.041058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 551/1102] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:39:26 2021] DELETE /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:39:27.050830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:27.051373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:27.057618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:27.058067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:27.058842 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:27.059283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:27.192778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:27.200166 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9ce666df-59c2-4891-b29f-d734096048e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1673 microversion: 2.1 time: 0.153471 Dec 08 11:39:27.200723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 552/1103] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:27 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:27.422760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:27.423770 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:27.430051 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:27.430490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:27.431282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:27.431722 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:27.623043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:27.623597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:27.629972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:27.630546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:27.631335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:27.631761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:27.692510 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a0a5ddf5-6ea5-4b7b-a186-37b0efc2a8fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.273585 Dec 08 11:39:27.693507 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 552/1104] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:27 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:27.773867 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:27.781251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.162044 Dec 08 11:39:27.781822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 553/1105] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:27 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:39:28.218297 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:28.218994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:28.225820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:28.226267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:28.227037 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:28.227472 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:28.355038 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:28.362832 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b7a43df6-6485-419a-a56b-161522819d73 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1673 microversion: 2.1 time: 0.148508 Dec 08 11:39:28.363395 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 553/1106] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:28 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:28.704056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:28.704882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:28.711095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:28.711544 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:28.712317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:28.712976 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:28.784398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8a3b1758-89f6-4ac2-b24e-ab470795941f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.083750 Dec 08 11:39:28.788856 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 554/1107] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:28 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:28.798455 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:28.799288 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:28.805672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:28.806203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:28.807049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:28.807555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:29.304322 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:29.311742 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-982f696d-72d7-492a-b3e9-ae0329d1c548 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1576 microversion: 2.1 time: 0.516896 Dec 08 11:39:29.312513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 554/1108] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:28 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1576 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:29.380082 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:29.380718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:29.387961 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:29.388409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:29.389807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:29.390259 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:29.616279 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:29.623607 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6f6301d3-e109-4004-af4d-ac00ce18be8f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 200 len: 1673 microversion: 2.1 time: 0.247555 Dec 08 11:39:29.624174 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 555/1109] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:29 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:29.801101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:29.802091 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:29.808325 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:29.808774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:29.809585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:29.810015 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:29.881084 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aa9423c3-d07d-481b-ba95-b260023d7de4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.083464 Dec 08 11:39:29.883204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 555/1110] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:29 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:29.974859 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-ebf5d62d-66b8-427c-8a56-cfc0dbd470e0 req-9d8e4f02-25ce-4838-ae62-709d690269bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "name": "network-vif-deleted", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:29.976368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:29.976368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:39:29.986293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-ebf5d62d-66b8-427c-8a56-cfc0dbd470e0 req-9d8e4f02-25ce-4838-ae62-709d690269bf service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:29.986748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-ebf5d62d-66b8-427c-8a56-cfc0dbd470e0 req-9d8e4f02-25ce-4838-ae62-709d690269bf service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.001052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-ebf5d62d-66b8-427c-8a56-cfc0dbd470e0 req-9d8e4f02-25ce-4838-ae62-709d690269bf service nova] Creating event network-vif-deleted:731fa8a4-e27d-4561-a86e-aa21c87548e7 for instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 on hv-cinder-81977 Dec 08 11:39:30.008475 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-ebf5d62d-66b8-427c-8a56-cfc0dbd470e0 req-9d8e4f02-25ce-4838-ae62-709d690269bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037402 Dec 08 11:39:30.009738 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 556/1111] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:39:30.329563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:30.330261 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:30.337633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:30.338085 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.338865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:30.339296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.472199 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:30.479782 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-85c4b2e6-4899-4013-b784-d4894ef5dc71 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1563 microversion: 2.1 time: 0.154330 Dec 08 11:39:30.493294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 556/1112] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:30 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:30.646360 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:30.648028 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:30.655723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:30.658470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.660162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:30.660834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.677306 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] HTTP exception thrown: Instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 could not be found. Dec 08 11:39:30.678825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Returning 404 to user: Instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:39:30.679919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-743c4ddd-5f06-4d24-a548-f7c37401df3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 404 len: 111 microversion: 2.1 time: 0.043029 Dec 08 11:39:30.680705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 557/1113] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:30 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:39:30.690704 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cd371470-b6dd-40c9-a9a2-c10c8ec1903f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '.version_select at 0x7f1fa6deadc0>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:30.716481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cd371470-b6dd-40c9-a9a2-c10c8ec1903f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025329047" status: 202 len: 0 microversion: 2.1 time: 0.030334 Dec 08 11:39:30.718745 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 557/1114] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Dec 8 11:39:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025329047 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:30.899020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:30.903390 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:30.910820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:30.911406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.912368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:30.913047 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:30.977898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-49478d52-6132-4d6f-99ae-c63c959d8440 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.087481 Dec 08 11:39:30.983478 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 558/1115] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:30 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:31.476435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a3c892d2-4a7d-41fd-a642-74a2f850801b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: .version_select at 0x7f1fa6527a60>, body: {"keypair": {"name": "tempest-keypair-1099855473"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:31.490773 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-a3c892d2-4a7d-41fd-a642-74a2f850801b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:39:31.494742 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-a3c892d2-4a7d-41fd-a642-74a2f850801b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for user 19df77156f4d40bab9337d27d4301a31 and project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:39:31.750243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-a3c892d2-4a7d-41fd-a642-74a2f850801b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:39:31.753848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-a3c892d2-4a7d-41fd-a642-74a2f850801b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for user 19df77156f4d40bab9337d27d4301a31 and project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:39:31.767159 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a3c892d2-4a7d-41fd-a642-74a2f850801b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.295136 Dec 08 11:39:31.767758 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 558/1116] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Dec 8 11:39:31 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:31.992622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:31.994282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:32.001103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:32.001579 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:32.002366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:32.002799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:32.042477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-3dd510a9-002d-4aa8-8cf8-d8581ca385ff req-521b46af-4f90-4429-a6c1-de89a494619b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:32.044008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:32.044008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:39:32.050878 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-3dd510a9-002d-4aa8-8cf8-d8581ca385ff req-521b46af-4f90-4429-a6c1-de89a494619b service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:32.051542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-3dd510a9-002d-4aa8-8cf8-d8581ca385ff req-521b46af-4f90-4429-a6c1-de89a494619b service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:32.063620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-3dd510a9-002d-4aa8-8cf8-d8581ca385ff req-521b46af-4f90-4429-a6c1-de89a494619b service nova] Creating event network-vif-plugged:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:39:32.068037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-17e65e7c-59a9-4c7f-8543-92784f56db3f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.080885 Dec 08 11:39:32.068612 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-3dd510a9-002d-4aa8-8cf8-d8581ca385ff req-521b46af-4f90-4429-a6c1-de89a494619b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030737 Dec 08 11:39:32.068752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 559/1117] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:31 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:32.069801 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 559/1118] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:39:33.015222 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-332619130", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "185aeb08-41ef-4fae-a420-33296f710850"}], "security_groups": [{"name": "tempest-securitygroup--118614222"}], "key_name": "tempest-keypair-1099855473", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:33.080771 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:33.081755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:33.088482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:33.088993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:33.089931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:33.090366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:33.116359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] validate_networks() for [('185aeb08-41ef-4fae-a420-33296f710850', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:39:33.154732 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8ad2b561-1d00-4158-8048-63e4b98ad254 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.078442 Dec 08 11:39:33.158714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 560/1119] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:33 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:33.476086 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:39:33.476565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:39:33.477032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:39:33.477463 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:39:33.477870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:39:33.486394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:33.486844 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:33.487675 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:33.488110 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:33.504104 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:39:33.508430 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Getting quotas for user 19df77156f4d40bab9337d27d4301a31 and project 9c60094b48d34489b46e92ae73d7e33a. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:39:33.519030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:39:33.521384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:39:33.568395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.557830 Dec 08 11:39:33.569575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 560/1120] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:39:33 2021] POST /compute/v2.1/servers => generated 401 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:39:33.579721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b4f604b7-5f6e-4678-8751-e08754ec5bee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:33.580422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b4f604b7-5f6e-4678-8751-e08754ec5bee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:33.635915 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b4f604b7-5f6e-4678-8751-e08754ec5bee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:33.642580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b4f604b7-5f6e-4678-8751-e08754ec5bee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1237 microversion: 2.1 time: 0.066825 Dec 08 11:39:33.643141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 561/1121] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:33 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:34.167481 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:34.168366 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:34.174649 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:34.175098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:34.175879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:34.176315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:34.242254 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4f5031c4-fcc6-4150-906e-6f7ea78c9701 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.079596 Dec 08 11:39:34.243109 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 561/1122] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:34 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:34.659586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:34.660201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:34.667365 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:34.667884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:34.668700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:34.669183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:34.737523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:34.745206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5d4f262b-93ef-4a03-a58f-77dadff88658 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1295 microversion: 2.1 time: 0.089266 Dec 08 11:39:34.745776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 562/1123] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:34 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:35.255142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:35.257551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:35.270693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:35.271343 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:35.272144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:35.272575 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:35.340851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f1a1f60d-19d1-4afc-8779-2f186f6a2aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28196 microversion: 2.20 time: 0.090007 Dec 08 11:39:35.344895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 562/1124] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:35 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28196 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:35.762631 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:35.763833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:35.770049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:35.770502 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:35.771283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:35.771720 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:35.804247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-278f0e13-6007-41dd-8ac0-2d72090e390c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:35.807210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:35.807210 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:39:35.819627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-278f0e13-6007-41dd-8ac0-2d72090e390c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:35.820412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-278f0e13-6007-41dd-8ac0-2d72090e390c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:35.832375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-278f0e13-6007-41dd-8ac0-2d72090e390c service nova] Creating event network-changed:973b8088-0638-45a6-9fe0-acffa26314d2 for instance 7f2f2abb-3bae-48d7-a02d-420f509114ca on hv-cinder-81977 Dec 08 11:39:35.837119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-278f0e13-6007-41dd-8ac0-2d72090e390c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036999 Dec 08 11:39:35.837789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 563/1125] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:39:36.034055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:36.041991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-aa24c265-3039-4a21-b975-7d15518ca828 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.282892 Dec 08 11:39:36.042596 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 563/1126] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:35 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:36.353508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:36.354495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:36.360705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:36.361171 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:36.362106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:36.362567 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:36.575923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-270c7fe7-1923-4376-9bb7-675de63d7d49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28487 microversion: 2.20 time: 0.227372 Dec 08 11:39:36.576573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 564/1127] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:36 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28487 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:37.058776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:37.059299 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:37.065528 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:37.066011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:37.066796 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:37.067240 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:37.198980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:37.206103 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ba8dc129-b582-4a28-98f5-3179deb6919e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.151218 Dec 08 11:39:37.206672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 564/1128] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:37 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:37.588857 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:37.590215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:37.596951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:37.597422 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:37.598198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:37.598628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:37.698830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b2bf514f-bead-492c-8e06-afa96ac38f9f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.114398 Dec 08 11:39:37.699500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 565/1129] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:37 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:38.222623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:38.223234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:38.229985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:38.230444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:38.231215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:38.231656 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:38.364034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:38.371853 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cf82fcd6-05de-4a48-8f28-26228d0166d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.152905 Dec 08 11:39:38.372425 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 565/1130] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:38 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:38.711037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:38.712458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:38.719293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:38.719749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:38.720529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:38.720971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:38.780501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b945037c-f8eb-4f5c-8b9e-4fb99adfe65a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.073551 Dec 08 11:39:38.781105 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 566/1131] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:38 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:39.388407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:39.389308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:39.395476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:39.395928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:39.396707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:39.397160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:39.528169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:39.535306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d4fc8121-80bf-4842-917a-331c381809d6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.150743 Dec 08 11:39:39.535870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 566/1132] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:39 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:39.792926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:39.793876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:39.800880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:39.801375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:39.802151 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:39.802619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:39.862462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c72a7f75-512e-4428-b2c6-5ec276569c8c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.074047 Dec 08 11:39:39.863334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 567/1133] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:39 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:40.551538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:40.552139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:40.559204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:40.559650 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:40.560429 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:40.560866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:40.687841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:40.694996 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.147122 Dec 08 11:39:40.695553 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 567/1134] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:40 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:40.874181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:40.875209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:40.882070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:40.882523 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:40.883297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:40.883738 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:40.948272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1e49540c-4b74-4290-800c-4ba5c5b5904e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.077952 Dec 08 11:39:40.948808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 568/1135] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:40 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:41.711471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:41.712110 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:41.718284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:41.718735 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:41.719501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:41.719937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:41.847658 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:41.854890 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b9e36188-afae-49fd-bc48-829586e56b3c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.147139 Dec 08 11:39:41.855454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 568/1136] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:41 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:41.960540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:41.961638 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:41.968847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:41.969339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:41.970143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:41.970587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:42.040898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d13912bb-0243-4f55-9b07-05a8c6d1dde3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.084239 Dec 08 11:39:42.041632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 569/1137] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:41 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:42.205251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-2b64e221-2be7-4914-b5ad-566349c48bab req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "name": "network-vif-plugged", "status": "completed", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:42.206789 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:42.206789 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:39:42.214582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-2b64e221-2be7-4914-b5ad-566349c48bab req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:42.214976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-2b64e221-2be7-4914-b5ad-566349c48bab req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:42.227554 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-2b64e221-2be7-4914-b5ad-566349c48bab req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 service nova] Creating event network-vif-plugged:973b8088-0638-45a6-9fe0-acffa26314d2 for instance 7f2f2abb-3bae-48d7-a02d-420f509114ca on hv-cinder-81977 Dec 08 11:39:42.232631 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-2b64e221-2be7-4914-b5ad-566349c48bab req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031296 Dec 08 11:39:42.233290 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 569/1138] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:39:42.871985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:42.872966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:42.880061 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:42.880515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:42.881325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:42.881769 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:43.009112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:43.016956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1362 microversion: 2.1 time: 0.149036 Dec 08 11:39:43.017545 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 570/1139] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:42 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:43.052060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:43.053055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:43.060083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:43.060539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:43.061436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:43.061873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:43.163991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e963bd1c-63da-4ef7-a0e3-4e533aeabe4e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.115649 Dec 08 11:39:43.164848 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 570/1140] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:43 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:44.034144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:44.034758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:44.041020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:44.041498 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:44.042288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:44.042728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:44.174438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:39:44.176403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:44.177520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:44.182266 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1548 microversion: 2.1 time: 0.151790 Dec 08 11:39:44.182829 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 571/1141] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:39:44 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:39:44.184114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:44.184644 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:44.185539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:44.186065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:44.204795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:39:44.204795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:44.208385 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:44.208838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:44.209654 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:44.210090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:44.257175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7af35b08-b9dd-4656-9a9a-1d1cb47904ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.085127 Dec 08 11:39:44.261224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 571/1142] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:44 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:44.294796 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-15c67e16-739f-4c65-91c6-528f8e6d3023 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099484 Dec 08 11:39:44.295386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 572/1143] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Dec 8 11:39:44 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:39:45.269482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:45.270552 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:45.277965 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:45.278423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:45.279216 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:45.279653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:45.341884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-659b7c06-86ba-4a99-b8bc-295e7db04b9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.076336 Dec 08 11:39:45.345781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 572/1144] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:45 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:45.470940 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:45.471979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:45.473141 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:45.474637 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:39:45.474637 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:39:45.478957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:45.479482 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:45.480353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:45.480847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:45.482538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:45.482990 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:45.494830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 service nova] Creating event network-changed:973b8088-0638-45a6-9fe0-acffa26314d2 for instance 7f2f2abb-3bae-48d7-a02d-420f509114ca on hv-cinder-81977 Dec 08 11:39:45.499695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030316 Dec 08 11:39:45.500488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 573/1145] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:39:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:39:45.543346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-27698ee5-68e2-4735-a40d-a2b295a58eb5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.076145 Dec 08 11:39:45.546698 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 573/1146] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:45 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:46.355239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:46.356151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:46.362533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:46.363394 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:46.363832 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:46.364276 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:46.425353 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5962d24e-2244-41a9-9f75-985f92972f1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.075145 Dec 08 11:39:46.429302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 574/1147] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:46 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:46.554572 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:46.555600 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:46.562479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:46.562932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:46.563708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:46.564146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:46.635968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1bb40b0c-6883-4431-97ed-be1335458e0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.085199 Dec 08 11:39:46.636500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 574/1148] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:46 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:47.437513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:47.438522 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:47.445371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:47.445826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:47.446610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:47.447053 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:47.517106 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-781acade-1545-4ac1-bcfd-72fbdcace947 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.083613 Dec 08 11:39:47.517746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 575/1149] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:47 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:47.647768 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:47.649305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:47.656603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:47.657310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:47.658351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:47.659502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:47.718263 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c7540db3-a304-427d-b43f-953950993744 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.074771 Dec 08 11:39:47.719061 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 575/1150] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:47 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:48.529142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:48.530169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:48.536974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:48.537460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:48.538244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:48.538681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:48.603229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-99b58f93-8c25-497f-958f-8d1fa1f7d202 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.078041 Dec 08 11:39:48.603838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 576/1151] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:48 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 08 11:39:48.729910 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:48.730841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:48.737632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:48.738078 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:48.738850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:48.739280 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:48.800518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a327f5a4-1c99-4abd-ad39-4226ad9d8734 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.075071 Dec 08 11:39:48.801116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 576/1152] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:48 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:49.615302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:49.616308 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:49.623123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:49.623579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:49.624359 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:49.624795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:49.687598 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c8f49bb0-17e6-49b0-a043-3c8c39b2cac8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.076300 Dec 08 11:39:49.688213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 577/1153] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:49 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:49.811956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:49.812949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:49.819730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:49.820198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:49.820967 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:49.821433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:49.879569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ac926c0a-6465-41cc-b9de-08c92b5c0c0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.071364 Dec 08 11:39:49.880129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 577/1154] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:49 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 08 11:39:50.698975 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:50.700034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:50.706960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:50.707357 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:50.708136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:50.708572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:50.783211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-195fd1c2-03b9-4066-b185-c5b50e9b1f3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.088151 Dec 08 11:39:50.783836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 578/1155] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:50 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:50.890807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:50.891827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:50.899121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:50.899565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:50.900335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:50.900765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:50.963978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f27f9594-6172-4715-83a3-0938fc22da80 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077207 Dec 08 11:39:50.964493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 578/1156] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:50 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 08 11:39:51.796008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:51.796914 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:51.804009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:51.805079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:51.805911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:51.806343 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:51.866523 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-69a22774-b374-4a1e-a32a-97838b980904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.074721 Dec 08 11:39:51.867781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 579/1157] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:51 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:51.974569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:51.975597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:51.983005 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:51.983454 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:51.984234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:51.984669 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:52.049923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-42d2dd42-1d9f-49d4-809d-91b3f4554256 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.079106 Dec 08 11:39:52.050485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 579/1158] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:51 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:52.879162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:52.880165 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:52.887623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:52.888078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:52.889113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:52.889577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:52.957102 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2516fe8d-5744-40e2-8e48-9b5c63ae1474 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.081908 Dec 08 11:39:52.957750 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 580/1159] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:52 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:53.062113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:53.063116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:53.069882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:53.070926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:53.071700 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:53.072135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:53.130386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-00e6aad5-0ad5-46ef-84f8-8b638376fa56 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.072093 Dec 08 11:39:53.130928 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 580/1160] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:53 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:53.968887 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:53.969926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:53.977219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:53.977676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:53.978460 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:53.978904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:54.051893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9e0a7ab0-1bc4-4840-9d58-a0e80ed7a070 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.087172 Dec 08 11:39:54.052559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 581/1161] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:53 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:54.142509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:54.143517 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:54.151032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:54.151489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:54.152278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:54.152729 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:54.213955 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8c2939ad-1020-46ae-ae4a-bacebfc44229 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.075559 Dec 08 11:39:54.214557 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 581/1162] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:54 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:55.064076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:55.064990 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:55.071771 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:55.072219 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:55.073000 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:55.073462 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:55.144003 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3174c1f2-6772-486c-85f0-394368f2d870 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.083910 Dec 08 11:39:55.144610 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 582/1163] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:55 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:55.224240 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:55.225310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:55.232850 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:55.233336 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:55.234126 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:55.234568 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:55.297286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6c74eb41-1836-40ce-adf5-b5cccb85ad49 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.076817 Dec 08 11:39:55.297953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 582/1164] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:55 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:39:56.156006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:56.157009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:56.164428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:56.164882 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:56.165700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:56.166139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:56.239653 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-dcac9b6c-24b8-4b54-b5fc-207f34c3a8ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.087651 Dec 08 11:39:56.240280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 583/1165] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:56 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:56.309177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:56.310193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:56.317008 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:56.317486 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:56.318268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:56.318708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:56.380485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7b67b708-f5c4-4631-af74-f0cda1b91975 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 14 microversion: 2.1 time: 0.075829 Dec 08 11:39:56.380999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 583/1166] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:56 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 08 11:39:57.252498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:57.253520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:57.260741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:57.261213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:57.261985 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:57.262421 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:57.332923 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-62405358-0005-4c73-9b2a-9cf7194bbd97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.084329 Dec 08 11:39:57.333598 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 584/1167] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:57 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:57.391929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:57.392847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:57.399679 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:57.400129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:57.400907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:57.401379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:57.474000 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0dc0ff89-6d79-406a-bc6d-4d6c243e4afc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 12027 microversion: 2.1 time: 0.086368 Dec 08 11:39:57.474596 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 584/1168] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:57 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 12027 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:39:58.344499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:58.345431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:58.352856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:58.353346 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:58.354117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:58.354558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:58.421283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-58d1abdc-d8d3-4ce0-bcf9-b4ed4eff160e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.080825 Dec 08 11:39:58.422178 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 585/1169] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:58 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:58.485456 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:58.486461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:58.493340 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:58.493798 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:58.494574 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:58.495010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:58.563589 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4ec84f68-fc7f-4a17-a566-dc57ad25677b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 18561 microversion: 2.1 time: 0.082124 Dec 08 11:39:58.564188 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 585/1170] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:58 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 18561 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:39:59.433906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:59.434825 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:59.441563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:59.442013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:59.442810 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:59.443244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:59.506713 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1c4d7d21-4c2e-4a12-923f-df81036fc819 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.077456 Dec 08 11:39:59.507374 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 586/1171] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:39:59 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:39:59.574438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:39:59.575439 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:39:59.582251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:59.582704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:59.583485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:39:59.583925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:39:59.655367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-98a3c10c-bc8b-4e9c-9ca1-289554a408a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 19342 microversion: 2.1 time: 0.084747 Dec 08 11:39:59.655981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 586/1172] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:39:59 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 19342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:00.518918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:00.519912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:00.526721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:00.527164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:00.527938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:00.528369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:00.599230 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-be8124c4-4a89-47dc-a050-a62abb136593 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.084195 Dec 08 11:40:00.599906 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 587/1173] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:00 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:00.666919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:00.667925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:00.674810 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:00.675267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:00.676055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:00.676499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:00.755185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dd0750c6-35a9-41e3-9b34-db058f90e37e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 21935 microversion: 2.1 time: 0.092653 Dec 08 11:40:00.755747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 587/1174] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:00 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 21935 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:01.612738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:01.613761 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:01.621206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:01.621657 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:01.622434 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:01.622870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:01.685838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-64f9432d-520f-4a37-9ddc-cc0a2d919e56 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.077014 Dec 08 11:40:01.686481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 588/1175] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:01 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:01.766431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:01.767428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:01.774904 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:01.775358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:01.776134 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:01.776573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:01.851672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0a9f3bff-48fe-408f-b246-82d1dc9278e9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 23235 microversion: 2.1 time: 0.089285 Dec 08 11:40:01.852523 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 588/1176] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:01 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 23235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:02.698574 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:02.699572 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:02.706408 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:02.706805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:02.707578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:02.708010 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:02.768808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ea5bc9c9-a052-4095-8ef1-fe6dcbddcd9d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.074778 Dec 08 11:40:02.769453 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 589/1177] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:02 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:02.863427 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:02.864431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:02.871763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:02.872215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:02.872993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:02.873467 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:02.949129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-83d395b3-7299-4b3d-8bf2-8b890e60fbcb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 24646 microversion: 2.1 time: 0.089605 Dec 08 11:40:02.949786 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 589/1178] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:02 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 24646 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:03.780352 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:03.781404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:03.788209 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:03.789175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:03.789972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:03.790411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:03.850851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e4dbea3a-0a0b-4f35-92b3-d80987b2d693 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.074470 Dec 08 11:40:03.851978 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 590/1179] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:03 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:03.960991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:03.962018 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:03.968802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:03.969288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:03.970070 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:03.970512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:04.043308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ce1f375f-9704-409a-84a1-532adc3d8425 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 26252 microversion: 2.1 time: 0.086217 Dec 08 11:40:04.043856 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 590/1180] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:03 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 26252 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:04.863309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:04.864330 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:04.871713 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:04.872168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:04.872951 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:04.873420 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:04.941874 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-664a788a-afcd-4596-a0a2-620f519b83a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.082471 Dec 08 11:40:04.942503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 591/1181] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:04 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:05.055667 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:05.056656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:05.063530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:05.063979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:05.064759 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:05.065227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:05.149353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-77a82054-f489-4a6f-b466-cae3dff28dc5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 27419 microversion: 2.1 time: 0.097966 Dec 08 11:40:05.149905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 591/1182] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:05 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 27419 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:05.954126 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:05.955129 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:05.961950 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:05.962409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:05.963186 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:05.963621 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:06.029809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4c4846d9-d88e-4190-9ea9-0e80c6b9b05b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.079599 Dec 08 11:40:06.030657 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 592/1183] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:05 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:06.160440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:06.161457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:06.168672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:06.169118 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:06.169927 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:06.170358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:06.253969 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a06a70d2-0b52-4dd7-9940-fbdfdfba904f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 27830 microversion: 2.1 time: 0.097427 Dec 08 11:40:06.254747 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 592/1184] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:06 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 27830 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:07.041767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:07.042771 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:07.049602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:07.050059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:07.050843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:07.051284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:07.115025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5d9c4635-560b-4db8-baee-27d4ba2893b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 28655 microversion: 2.20 time: 0.077221 Dec 08 11:40:07.115727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 593/1185] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:07 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 28655 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:07.266363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:07.267406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:07.274294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:07.274746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:07.275531 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:07.275972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:07.352368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2e1fed8b-fc2c-4236-91a8-86c9b1d315aa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.090249 Dec 08 11:40:07.353237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 593/1186] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:07 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:08.126693 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:08.127706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:08.135147 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:08.135597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:08.136369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:08.136804 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:08.209509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-92eda50d-e6fd-41a5-bf4b-cdddfd3685bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 30374 microversion: 2.20 time: 0.086678 Dec 08 11:40:08.210121 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 594/1187] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:08 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 30374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:08.364335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:08.365273 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:08.372730 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:08.373193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:08.373975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:08.374407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:08.436417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-04bd7871-1578-4a9f-bf4c-cb600bf04d26 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.076045 Dec 08 11:40:08.437334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 594/1188] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:08 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:09.221576 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:09.222578 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:09.229441 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:09.229896 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:09.230681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:09.231117 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:09.302956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-67cbe5eb-c207-43a0-b97f-6b84c06c0e96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 32317 microversion: 2.20 time: 0.085337 Dec 08 11:40:09.304385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 595/1189] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:09 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 32317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:09.448907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:09.449860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:09.456632 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:09.457077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:09.457876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:09.458305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:09.517798 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6534114b-bb33-4681-a250-ed5563851283 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.073376 Dec 08 11:40:09.518670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 595/1190] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:09 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:10.315607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:10.316602 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:10.323779 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:10.324239 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:10.325039 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:10.325540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:10.399633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fae35fe3-ffd1-4ee3-9d81-b2bbb33ada1a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 33532 microversion: 2.20 time: 0.087883 Dec 08 11:40:10.400228 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 596/1191] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:10 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 33532 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:10.530164 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:10.531197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:10.538062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:10.538516 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:10.539300 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:10.539739 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:10.602061 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-19e03614-d93a-4529-962f-42f06abc7353 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.075815 Dec 08 11:40:10.602909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 596/1192] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:10 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:11.412362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:11.413824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:11.420721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:11.421202 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:11.421999 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:11.422444 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:11.506265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-43706718-b2d0-4806-abf8-d809d87efd86 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 34646 microversion: 2.20 time: 0.097879 Dec 08 11:40:11.506918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 597/1193] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:11 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 34646 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:11.613870 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:11.614872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:11.621697 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:11.622144 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:11.622916 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:11.623351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:11.684808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3eee8d62-49c2-4446-b43a-92cb7b4d5b68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.074685 Dec 08 11:40:11.685371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 597/1194] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:11 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:12.519331 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:12.520340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:12.527767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:12.528225 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:12.529011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:12.529514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:12.599577 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a4f5bc54-6c1b-4db0-92ea-1c8ae09c4755 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 35741 microversion: 2.20 time: 0.084234 Dec 08 11:40:12.600202 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 598/1195] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:12 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 35741 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:12.698277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:12.699952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:12.707380 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:12.707884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:12.708689 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:12.709121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:12.774044 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-15ebee06-5a2d-4a9b-9140-1c54ed4c2148 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.081603 Dec 08 11:40:12.774582 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 598/1196] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:12 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:13.612349 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:13.613375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:13.622223 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:13.622678 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:13.623475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:13.623918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:13.696569 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-25c8cc97-4f70-4dbf-b0db-b77b967f1632 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 37393 microversion: 2.20 time: 0.088111 Dec 08 11:40:13.697508 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 599/1197] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:13 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 37393 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:13.785864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:13.786912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:13.793746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:13.794206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:13.794990 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:13.795433 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:13.856011 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f43cfbe6-3bd6-45f2-9295-bb11b967279a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.074092 Dec 08 11:40:13.856912 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 599/1198] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:13 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:14.708920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:14.710478 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:14.717344 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:14.717739 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:14.718520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:14.718966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:14.792748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a367eabd-45e1-44a7-b803-70eb5a46d93d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 38213 microversion: 2.20 time: 0.087721 Dec 08 11:40:14.794003 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 600/1199] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:14 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 38213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:14.868132 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:14.869342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:14.876111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:14.876557 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:14.877371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:14.877812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:14.947604 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3acb2f02-9ae9-48f1-ab42-f651bf3c3f72 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.083356 Dec 08 11:40:14.951465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 600/1200] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:14 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:15.805954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:15.806945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:15.813802 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:15.814252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:15.815025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:15.815456 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:15.875206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c36ee034-70c4-496d-bbda-9974db3ca697 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 38213 microversion: 2.20 time: 0.073782 Dec 08 11:40:15.875823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 601/1201] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:15 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 38213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:15.959553 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:15.960552 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:15.967446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:15.967898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:15.968684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:15.969122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:16.028869 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-57459fdd-d697-453b-b27b-05914503b19b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.073214 Dec 08 11:40:16.029765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 601/1202] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:15 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:16.887897 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:16.889209 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:16.896034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:16.896487 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:16.897317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:16.897759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:16.958501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4322781e-ef84-4a24-ba68-7c1610378a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 38213 microversion: 2.20 time: 0.074518 Dec 08 11:40:16.959134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 602/1203] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:16 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 38213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:17.040331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:17.041359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:17.048271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:17.048723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:17.049653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:17.050133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:17.123046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ece329bc-0173-4e95-9079-5d8755e9c989 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.086635 Dec 08 11:40:17.123926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 602/1204] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:17 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:17.971807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:17.972765 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:17.980422 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:17.980877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:17.981714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:17.982158 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:18.063238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f0de1c3d-b384-4fac-ab55-2d116864cbd0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 38213 microversion: 2.20 time: 0.096195 Dec 08 11:40:18.063882 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 603/1205] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:17 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 38213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:18.135465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:18.136502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:18.143682 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:18.144158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:18.144926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:18.145472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:18.211535 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-46c0eb3a-f8a8-40c6-829e-1656b5f1696e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.080414 Dec 08 11:40:18.212171 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 603/1206] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:18 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:19.076164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:19.077224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:19.084314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:19.084758 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:19.085583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:19.086019 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:19.174855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d314d9f6-b5eb-4ab7-97d8-f40cb2425cde tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 200 len: 38356 microversion: 2.20 time: 0.102544 Dec 08 11:40:19.175767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 604/1207] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:19 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 38356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:40:19.186211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:19.186798 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:19.195095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:19.195537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:19.196318 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:19.196752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:19.219770 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b1d5a752-739f-4da2-a484-1532aada21c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/ips" status: 200 len: 151 microversion: 2.20 time: 0.037556 Dec 08 11:40:19.220304 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 604/1208] 10.222.0.66 () {60 vars in 1288 bytes} [Wed Dec 8 11:40:19 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:19.223981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:19.224982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:19.231946 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:19.232411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:19.233286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:19.233734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:19.299496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-eef0a524-f727-4e7e-b85e-d8369fa5b14c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.079338 Dec 08 11:40:19.300143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 605/1209] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:19 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:20.311817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:20.312758 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:20.319484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:20.319930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:20.320699 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:20.321131 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:20.392329 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e7b5d67c-b28c-4dbc-a32f-2f0993eda482 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.084004 Dec 08 11:40:20.392901 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 605/1210] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:20 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:21.330345 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:21.330974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:21.338442 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:21.338900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:21.339685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:21.340125 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:21.364012 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lazy-loading 'flavor' on Instance uuid 20f4bc10-4a61-47a6-857a-48e682893ae3 {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:40:21.404091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:21.405253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:21.412375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:21.413587 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:21.414550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:21.415055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:21.484644 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ffae30a7-4476-4dbb-a0bc-1e502fbdf4eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28192 microversion: 2.1 time: 0.084364 Dec 08 11:40:21.485633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 606/1211] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:21 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:21.622222 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9067ed95-1c16-4958-b680-915e47108433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 202 len: 0 microversion: 2.20 time: 0.295681 Dec 08 11:40:21.624826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 606/1212] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:40:21 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:40:21.634282 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:21.634993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:21.642561 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:21.642952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:21.643749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:21.644202 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:21.778403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:21.786050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:21.787535 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:21.788676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-85fdcaf2-67de-40bf-b60f-801bbe31b433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.161162 Dec 08 11:40:21.789238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 607/1213] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:21 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:22.496662 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:22.497698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:22.504781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:22.505260 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:22.506039 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:22.506977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:22.582905 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e064a5c2-f9f7-413c-aed8-9d83e391b900 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28483 microversion: 2.1 time: 0.090562 Dec 08 11:40:22.583579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 607/1214] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:22 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28483 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:22.807555 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:22.808164 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:22.814430 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:22.814884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:22.815664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:22.816105 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:22.946941 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:22.954571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:22.956068 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:22.957258 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.153969 Dec 08 11:40:22.957811 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 608/1215] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:22 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:23.595626 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:23.596697 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:23.604216 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:23.604672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:23.605494 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:23.605937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:23.666094 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-01fa9fe8-0a3e-4597-9798-8527b1e2025f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28483 microversion: 2.1 time: 0.074423 Dec 08 11:40:23.666968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 608/1216] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:23 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28483 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:23.974515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:23.975546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:23.981858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:23.982313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:23.983092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:23.983530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:24.112453 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:24.120893 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:24.122441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:24.123608 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-20d4933a-535e-4617-8cae-000a312fb011 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.152924 Dec 08 11:40:24.124162 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 609/1217] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:23 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:24.677841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:24.678797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:24.685595 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:24.686046 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:24.686821 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:24.687255 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:24.764951 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-95c25305-57d5-4016-8c93-d64b21681bfa tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.091187 Dec 08 11:40:24.765623 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 609/1218] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:24 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:25.141748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:25.142362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:25.149140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:25.149618 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:25.150399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:25.150842 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:25.283018 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:25.291361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:25.292866 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:25.294062 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.156314 Dec 08 11:40:25.294621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 610/1219] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:25 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:25.777029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:25.778059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:25.786143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:25.786608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:25.787401 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:25.787866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:25.855698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-660951c5-7465-42ea-9a8a-07fe5bd9609d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.083241 Dec 08 11:40:25.856338 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 610/1220] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:25 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:26.311599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:26.312211 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:26.318510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:26.318957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:26.319732 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:26.320165 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:26.451419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:26.459037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:26.460530 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:26.461718 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-da5c4cf8-7606-4974-a54c-3822d40fde48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.153870 Dec 08 11:40:26.462275 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 611/1221] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:26 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:26.867447 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:26.868455 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:26.875329 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:26.875781 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:26.876568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:26.877005 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:26.940900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7612a06e-7355-4dee-bcaa-5bffe1ec5460 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.077419 Dec 08 11:40:26.942254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 611/1222] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:26 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:27.480016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:27.480538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:27.486812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:27.487271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:27.488051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:27.488507 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:27.617050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:27.624674 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:27.626183 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:27.627317 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-89069132-89ec-40c8-9206-8e75b47776c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.151214 Dec 08 11:40:27.627866 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 612/1223] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:27 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:27.953600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:27.954609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:27.961561 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:27.962016 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:27.962794 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:27.963234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:28.023514 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d103fe90-ae7f-451f-8238-72c559b897eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.073823 Dec 08 11:40:28.024423 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 612/1224] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:27 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:28.645808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:28.646539 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:28.653404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:28.653878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:28.654650 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:28.655083 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:28.783831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:28.791451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:28.792937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:28.794129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.152012 Dec 08 11:40:28.794683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 613/1225] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:28 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:40:29.035240 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:29.036163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:29.043006 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:29.043463 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:29.044252 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:29.044694 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:29.105835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-49a8f084-7d6c-4da4-b22c-cf46ce2d2c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.074500 Dec 08 11:40:29.107259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 613/1226] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:29 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:29.811608 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:29.812316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:29.818648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:29.819097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:29.819873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:29.820307 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:29.949915 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:29.957540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:29.959031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:29.960890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-30cc9281-0ea5-436b-83d5-ce05086387f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.152932 Dec 08 11:40:29.961496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 614/1227] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:29 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:30.117158 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:30.118188 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:30.124969 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:30.125479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:30.126360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:30.126710 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:30.187886 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-95788e42-d8af-4ef2-9bb5-51e10adf1eec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.074594 Dec 08 11:40:30.188784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 614/1228] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:30 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:30.979294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:30.979907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:30.986217 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:30.986673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:30.987457 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:30.987905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:31.119822 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:31.127541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:31.129039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:31.130230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.155192 Dec 08 11:40:31.130793 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 615/1229] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:30 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:31.199305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:31.200312 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:31.207153 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:31.207608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:31.208384 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:31.208822 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:31.270806 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-babf66b8-d29d-4ca7-98c2-87a7b92fb35d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.075400 Dec 08 11:40:31.271351 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 615/1230] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:31 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:32.148617 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:32.149263 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:32.155683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:32.156138 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:32.156923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:32.157394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:32.282926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:32.283935 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:32.286014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:32.290811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:32.291267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:32.292062 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:32.292503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:32.293902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:32.295407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:32.296583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f6fa163c-2857-4c73-9de4-8cab4ae2293d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.152224 Dec 08 11:40:32.297142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 616/1231] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:32 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:32.355273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1b4c824b-86cc-4c95-9f9b-7e9c26653134 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.076154 Dec 08 11:40:32.355814 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 616/1232] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:32 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:33.314624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:33.315355 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:33.322308 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:33.322762 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:33.323541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:33.323980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:33.367722 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:33.368655 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:33.375489 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:33.375948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:33.376736 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:33.377189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:33.446438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ffd1cb2d-283d-4dd1-a0ee-a24365ca16a0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.083148 Dec 08 11:40:33.447388 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 617/1233] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:33 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:33.457479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:33.465303 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:33.466795 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:33.467948 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-33670374-f303-48fd-8a31-58ef4bd82656 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.157086 Dec 08 11:40:33.468500 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 617/1234] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:33 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:40:34.458505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:34.460059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:34.466833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:34.467280 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:34.468053 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:34.468490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:34.485519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:34.486132 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:34.492400 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:34.492849 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:34.493671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:34.494111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:34.533918 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f8b4f74b-4c10-427f-beef-6c300aa400e7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.079294 Dec 08 11:40:34.537786 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 618/1235] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:34 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:34.621565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:34.629045 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:34.630619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:34.632264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.150447 Dec 08 11:40:34.632807 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 618/1236] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:34 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:40:35.545865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:35.546784 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:35.554229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:35.554685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:35.555455 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:35.555893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:35.614636 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-73722988-1b57-4f3c-99a4-df57d67c3f5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.072714 Dec 08 11:40:35.615271 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 619/1237] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:35 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:35.650645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:35.651245 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:35.657524 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:35.657974 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:35.658744 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:35.659177 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:35.794526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:35.802256 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:35.804187 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:35.805484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.159089 Dec 08 11:40:35.806030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 619/1238] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:35 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:36.626587 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:36.627586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:36.634416 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:36.634867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:36.635638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:36.636072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:36.697995 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2cd5b3d1-5541-402a-8abe-ba2f80392132 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.075233 Dec 08 11:40:36.698627 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 620/1239] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:36 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:36.823899 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:36.824419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:36.830665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:36.831113 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:36.831909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:36.832348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:36.961851 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:36.969451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:36.970942 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:36.972092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-67c14805-b8e3-46e6-80c6-5f53f052daf4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.152093 Dec 08 11:40:36.972644 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 620/1240] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:36 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:37.710597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:37.711606 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:37.718470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:37.718923 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:37.719706 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:37.720148 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:37.815590 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-445b560b-546a-4ffd-9d1e-d9a1fa469b1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.108881 Dec 08 11:40:37.816475 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 621/1241] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:37 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:37.990622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:37.991331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:37.997405 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:37.997864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:37.998642 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:37.999098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:38.126814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:38.135010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:38.136527 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:38.137706 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1745 microversion: 2.20 time: 0.151261 Dec 08 11:40:38.138510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 621/1242] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:37 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:38.827646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:38.828647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:38.835449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:38.835904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:38.836679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:38.837112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:38.902759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-61533efd-e7a2-40a6-b814-bfc6ececc6cc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.078967 Dec 08 11:40:38.903395 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 622/1243] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:38 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:39.155635 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:39.156242 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:39.163026 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:39.163484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:39.164264 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:39.164845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:39.295307 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:39.303576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:39.305071 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:39.306257 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1745 microversion: 2.20 time: 0.154408 Dec 08 11:40:39.306808 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 622/1244] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:39 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:39.914895 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:39.915932 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:39.922760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:39.923215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:39.923992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:39.924433 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:39.993114 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fbbf25e0-e958-4ea8-8726-4e7ab3ab969b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.082161 Dec 08 11:40:39.994078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 623/1245] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:39 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:40.324554 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:40.325172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:40.331452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:40.331907 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:40.332683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:40.333116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:40.463374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:40.471412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:40.472920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:40.474117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0190d6b5-cbb5-4185-836b-d2093f68606a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1745 microversion: 2.20 time: 0.153245 Dec 08 11:40:40.475413 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 623/1246] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:40 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:41.005501 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:41.007104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:41.014258 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:41.014712 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:41.015491 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:41.015933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:41.077119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e9291f10-f740-4226-bd29-051b46f0912a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.075497 Dec 08 11:40:41.078035 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 624/1247] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:41 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:41.493065 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:41.493722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:41.499934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:41.500388 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:41.501178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:41.501619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:41.628281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:41.635836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:41.637357 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:41.638766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2b59ff18-1150-49e2-ba49-9a808e2dff5c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1745 microversion: 2.20 time: 0.150161 Dec 08 11:40:41.639313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 624/1248] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:41 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:42.089287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:42.090371 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:42.098300 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:42.098763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:42.100401 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:42.100585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:42.170083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9bbb0751-6708-4068-8eec-0b03dd40bca9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.084775 Dec 08 11:40:42.170956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 625/1249] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:42 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:42.394208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-a00b6dfa-2333-4bc0-99f9-6d0116a4ea57 req-e185735c-e705-4b9f-b529-8a955e56aa7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:42.395721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:40:42.395721 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:40:42.403546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a00b6dfa-2333-4bc0-99f9-6d0116a4ea57 req-e185735c-e705-4b9f-b529-8a955e56aa7d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:42.404003 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a00b6dfa-2333-4bc0-99f9-6d0116a4ea57 req-e185735c-e705-4b9f-b529-8a955e56aa7d service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:42.415757 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-a00b6dfa-2333-4bc0-99f9-6d0116a4ea57 req-e185735c-e705-4b9f-b529-8a955e56aa7d service nova] Creating event network-vif-plugged:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:40:42.420884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-a00b6dfa-2333-4bc0-99f9-6d0116a4ea57 req-e185735c-e705-4b9f-b529-8a955e56aa7d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 Dec 08 11:40:42.421525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 625/1250] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:40:42.657828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:42.658854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:42.666282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:42.666739 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:42.667524 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:42.667966 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:42.799584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:42.807289 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:42.808782 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:42.809974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-71846e5c-f2ba-4a63-8783-c03375c5aa3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1745 microversion: 2.20 time: 0.156578 Dec 08 11:40:42.810537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 626/1251] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:42 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:43.183164 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:43.184195 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:43.190292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:43.190751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:43.191538 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:43.191983 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:43.255414 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e880e8bd-9ed5-4484-b188-d48ec45424d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.076581 Dec 08 11:40:43.256693 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 626/1252] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:43 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:43.828139 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:43.828752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:43.835497 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:43.835947 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:43.836721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:43.837172 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:43.964614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:43.972244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:43.973768 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:43.975518 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1745 microversion: 2.20 time: 0.151096 Dec 08 11:40:43.976074 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 627/1253] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:43 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:44.268305 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:44.269326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:44.276704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:44.277176 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:44.277962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:44.278403 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:44.346830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f7fd27be-51d7-44ba-b454-429c0d89ba38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.082237 Dec 08 11:40:44.347391 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 627/1254] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:44 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:44.994317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:44.994934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:45.001748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:45.002447 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:45.003244 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:45.003687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:45.164406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:45.178960 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:45.180360 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:45.181811 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f1449fae-aead-40e1-bee2-ff629877eb8f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.192002 Dec 08 11:40:45.182849 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 628/1255] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:44 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:45.359106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:45.360391 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:45.367787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:45.368244 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:45.369039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:45.369519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:45.434551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ca1205b5-1b37-4b15-8d62-bac7c83e9f1f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.079336 Dec 08 11:40:45.435756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 628/1256] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:45 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:46.202724 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:46.203361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:46.211556 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:46.212321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:46.213127 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:46.213761 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:46.352866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:46.361108 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:46.362734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:46.363930 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-27314fe6-22fb-4fab-af78-8652fecde4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.167331 Dec 08 11:40:46.365185 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 629/1257] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:46 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:40:46.447570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:46.448744 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:46.455672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:46.456137 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:46.456930 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:46.457409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:46.527692 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-952711fc-117e-43ae-bab9-251142ca8dba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.084495 Dec 08 11:40:46.528353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 629/1258] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:46 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:47.382698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:47.383266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:47.389945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:47.390401 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:47.391194 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:47.391638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:47.540199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:47.542028 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:47.549407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:47.550260 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:47.551323 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:47.552014 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:47.556661 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:47.564761 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:47.566294 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:47.567479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b09a615a-589d-451d-abfb-fbe96273cb93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.189102 Dec 08 11:40:47.578668 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 630/1259] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:47 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:47.630251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-852d6a98-1847-4bae-937c-8ec5bb893eba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.093889 Dec 08 11:40:47.631611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 630/1260] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:47 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:48.585916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:48.587259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:48.593916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:48.594649 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:48.595707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:48.596369 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:48.644100 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:48.645283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:48.652861 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:48.653659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:48.654705 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:48.655289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:48.723636 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c491bd15-d0f9-4330-8093-782f001e69b2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.083382 Dec 08 11:40:48.725263 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 631/1261] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:48 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:48.741238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:48.749454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:48.751100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:48.752798 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7764f744-8f49-458c-b84a-d973394156d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.171103 Dec 08 11:40:48.753687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 631/1262] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:48 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:49.736271 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:49.738034 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:49.745472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:49.745932 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:49.746736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:49.747183 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:49.773019 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:49.773843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:49.781467 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:49.781928 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:49.782721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:49.783156 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:49.818483 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-881c00b5-eae1-4221-bbda-65fcdd60c6c0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.085389 Dec 08 11:40:49.819554 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 632/1263] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:49 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:49.919223 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:49.927586 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:49.929104 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:49.930358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c23b368a-ba9a-46a7-affc-ce788c060391 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.162152 Dec 08 11:40:49.931348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 632/1264] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:49 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:50.831528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:50.833344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:50.840316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:50.840766 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:50.841584 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:50.842006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:50.917676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-49700668-2e20-4d68-82a4-5cbc7c848333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.089903 Dec 08 11:40:50.918723 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 633/1265] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:50 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:50.947641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:50.948468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:50.954843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:50.955504 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:50.956518 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:50.956961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:51.108604 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:51.117169 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:51.118780 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:51.120025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.176208 Dec 08 11:40:51.120955 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 633/1266] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:50 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:51.930830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:51.932482 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:51.939792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:51.940253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:51.941056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:51.941526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:52.003873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cc78f4c9-69b3-4a11-a4a0-509b5d9b196a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.077489 Dec 08 11:40:52.004920 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 634/1267] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:51 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:52.138551 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:52.139155 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:52.145525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:52.146477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:52.147264 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:52.147700 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:52.285090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:52.295559 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:52.297655 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:52.299173 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-712b0565-8e93-4974-a946-a7a5a66e04ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.164619 Dec 08 11:40:52.300008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 634/1268] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:52 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:53.016995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:53.018017 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:53.026417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:53.027120 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:53.027917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:53.028379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:53.119209 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-34bcde85-ba8f-4da5-82c3-788e20020da7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.106594 Dec 08 11:40:53.120102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 635/1269] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:53 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:53.318099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:53.319348 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:53.325830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:53.326281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:53.327061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:53.327725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:53.480754 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:53.489211 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:53.492076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:53.493275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-43592422-acd5-4b3d-af92-f914aed7beb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.179001 Dec 08 11:40:53.493854 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 635/1270] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:53 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:54.131963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:54.132968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:54.140566 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:54.141020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:54.141873 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:54.142314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:54.213597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f409d94f-74cf-4fb1-bdd4-df757a9474b0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.085385 Dec 08 11:40:54.217614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 636/1271] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:54 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 08 11:40:54.511986 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:54.512592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:54.519411 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:54.520097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:54.521428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:54.521862 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:54.674924 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:54.683725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:54.685477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:54.686667 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f0a908fe-3484-433a-bf1e-00b545e135f9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.178969 Dec 08 11:40:54.687226 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 636/1272] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:54 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:55.225541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:55.226549 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:55.233431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:55.233890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:55.234671 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:55.235110 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:55.458098 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0a5bda3c-673a-4823-887a-023493f79c2e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.236379 Dec 08 11:40:55.458905 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 637/1273] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:55 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:55.705144 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:55.705752 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:55.712064 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:55.712458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:55.713266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:55.713703 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:55.852025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:55.859620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:55.861105 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:55.862273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-50c5ece6-4afe-448a-9653-7d9eae93eacc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1740 microversion: 2.20 time: 0.160900 Dec 08 11:40:55.862828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 637/1274] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:55 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:56.470088 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:56.471077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:56.478380 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:56.478826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:56.479598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:56.480031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:56.553142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5e02a0bb-35ba-4a3c-a294-b6d1a53743e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 28651 microversion: 2.1 time: 0.086150 Dec 08 11:40:56.553750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 638/1275] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:56 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 28651 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:56.879417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:56.880014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:56.886843 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:56.887301 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:56.888667 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:56.889250 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:57.020039 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:57.028886 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:57.030608 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:57.031823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-36a94ef1-fc57-4040-821f-b5bacc0c486a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1722 microversion: 2.20 time: 0.156216 Dec 08 11:40:57.032725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 638/1276] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:56 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:57.564480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:57.565412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:57.572215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:57.572656 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:57.573453 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:57.573882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:57.650964 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-82fd6446-a05d-4a3f-bd7b-7af64dadde0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 29580 microversion: 2.1 time: 0.090526 Dec 08 11:40:57.651826 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 639/1277] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:57 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 29580 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:58.049957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:58.050569 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:58.057303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:58.057765 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:58.058550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:58.058993 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:58.192427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:58.202569 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:58.204056 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:58.205238 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1722 microversion: 2.20 time: 0.159009 Dec 08 11:40:58.205794 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 639/1278] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:58 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:58.439459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-c97ce9b6-f3e5-4810-9015-85c285831343 req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:58.440943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:40:58.440943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:40:58.450989 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-c97ce9b6-f3e5-4810-9015-85c285831343 req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:58.451446 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-c97ce9b6-f3e5-4810-9015-85c285831343 req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:58.463496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-c97ce9b6-f3e5-4810-9015-85c285831343 req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 service nova] Creating event network-vif-unplugged:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:40:58.469485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-c97ce9b6-f3e5-4810-9015-85c285831343 req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033912 Dec 08 11:40:58.470665 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 640/1279] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:40:58.662350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:58.663266 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:58.669670 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:58.670152 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:58.670946 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:58.671385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:58.745166 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-98133f9f-f93d-404c-9280-0f629852f237 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 31663 microversion: 2.1 time: 0.086221 Dec 08 11:40:58.745987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 640/1280] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:58 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 31663 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:59.224059 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:59.224777 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:59.231731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.232178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.232944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.233407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.362599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:59.370810 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:59.372287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:40:59.373479 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1665 microversion: 2.20 time: 0.153387 Dec 08 11:40:59.374031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 641/1281] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:40:59 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:40:59.391391 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f88ebb1-4d15-4fce-b2da-5065bff410a9"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:59.392565 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:59.399375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.399856 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.400640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.401077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.644763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-502419e3-4150-4e15-bd03-5f94cf303a14 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.257769 Dec 08 11:40:59.645414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 641/1282] 10.222.0.66 () {62 vars in 1363 bytes} [Wed Dec 8 11:40:59 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-volume_attachments => generated 188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:59.750521 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:40:59.751012 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:59.755776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:40:59.756775 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:40:59.757221 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.757673 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.758458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.758889 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.763632 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.764093 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.764885 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:40:59.765367 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:40:59.837727 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f705bd4d-813d-49ef-bb89-8849785a26ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 33101 microversion: 2.1 time: 0.085430 Dec 08 11:40:59.842160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 642/1283] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:40:59 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 33101 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:40:59.982540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b6b28206-2601-46d1-bbe0-6cfbd065b1c0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-volume_attachments/3f88ebb1-4d15-4fce-b2da-5065bff410a9" status: 202 len: 0 microversion: 2.20 time: 0.235683 Dec 08 11:40:59.983117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 642/1284] 10.222.0.66 () {60 vars in 1456 bytes} [Wed Dec 8 11:40:59 2021] DELETE /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-volume_attachments/3f88ebb1-4d15-4fce-b2da-5065bff410a9 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:41:00.035753 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:00.036418 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:00.043177 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:00.043633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:00.044424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:00.044866 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:00.120215 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1dc29ac6-3648-4697-93bb-5637f14cb44d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action" status: 202 len: 0 microversion: 2.20 time: 0.088509 Dec 08 11:41:00.120816 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 643/1285] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Dec 8 11:41:00 2021] POST /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:41:00.128609 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:00.129235 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:00.136549 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:00.136996 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:00.138080 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:00.138522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:00.270590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:00.278622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:00.280119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:00.281448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-868db9cb-3613-4a07-ae3d-4db51d9dee97 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1673 microversion: 2.20 time: 0.156562 Dec 08 11:41:00.282054 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 643/1286] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:00 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:00.849921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:00.851036 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:00.857347 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:00.857808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:00.858630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:00.859134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:00.931183 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d5497ea0-99d9-4b6f-a347-903764bbd699 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 34254 microversion: 2.1 time: 0.085267 Dec 08 11:41:00.931795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 644/1287] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:41:00 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 34254 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:41:01.299614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:01.300936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:01.307707 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:01.308233 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:01.309024 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:01.309489 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:01.518775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:01.526651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:01.528202 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:01.529407 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.233501 Dec 08 11:41:01.529966 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 644/1288] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:01 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:01.943287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:01.944288 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:01.951017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:01.951470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:01.952259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:01.952692 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:02.028625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-94a3ded4-1d52-45bd-9489-02e99025f247 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 35545 microversion: 2.1 time: 0.089093 Dec 08 11:41:02.029295 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 645/1289] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:41:01 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 35545 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:41:02.548116 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:02.548728 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:02.555650 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:02.556159 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:02.557010 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:02.557651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:02.691197 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:02.700831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:02.702372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:02.703557 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.159150 Dec 08 11:41:02.704108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 645/1290] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:02 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:03.040814 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:03.041899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:03.049240 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:03.049920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:03.050920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:03.051525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:03.721472 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:03.722330 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:03.728299 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:03.728751 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:03.729599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:03.730042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:03.873124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:03.881660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:03.884298 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:03.886581 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.168776 Dec 08 11:41:03.888241 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 646/1291] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:03 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:04.905019 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:04.906645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:04.913487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:04.914836 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:04.915712 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:04.916218 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:05.051835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:05.060835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:05.062541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:05.063906 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-65a285f3-938a-43a3-8e39-1826499cdd92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.162621 Dec 08 11:41:05.074685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 647/1292] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:04 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:06.082278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:06.082923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:06.089902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:06.090358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:06.091234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:06.091594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:06.224184 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:06.232092 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:06.233629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:06.234797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.156361 Dec 08 11:41:06.235356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 648/1293] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:06 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:07.253683 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:07.255262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:07.263020 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:07.263484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:07.264283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:07.264749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:07.564206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:07.572419 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:07.573954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:07.575135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.325978 Dec 08 11:41:07.575897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 649/1294] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:07 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:08.103862 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:08.105727 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:08.111929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.112382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.113208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.113660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.156081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:41:08.243114 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cff536ee-1375-4b82-ab24-326f6a7428e8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 204 len: 0 microversion: 2.1 time: 0.143407 Dec 08 11:41:08.244277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 650/1295] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:41:08 2021] DELETE /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 08 11:41:08.259146 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16d51638-1668-412a-8015-9f0a5e6c6583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:08.260898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:41:08.260898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:41:08.269213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16d51638-1668-412a-8015-9f0a5e6c6583 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.269681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16d51638-1668-412a-8015-9f0a5e6c6583 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.280326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16d51638-1668-412a-8015-9f0a5e6c6583 service nova] Creating event network-changed:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:41:08.285379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16d51638-1668-412a-8015-9f0a5e6c6583 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 Dec 08 11:41:08.285963 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 651/1296] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:08.292825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:08.293950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:08.306752 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.307236 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.308102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.308550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.521031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:08.529099 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a77e2e1c-adc7-4d11-84c3-2335668209ec tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.241980 Dec 08 11:41:08.539447 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 652/1297] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:08 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:08.594685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:08.595365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:08.602123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.602529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.603425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:08.603872 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:08.745369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:08.753131 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:08.754777 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:08.756334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0218048e-5349-4519-9b29-7977febd9eb1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.165398 Dec 08 11:41:08.757285 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 653/1298] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:08 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:09.547416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:09.548050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:09.554929 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:09.555375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:09.556160 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:09.556592 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:09.691156 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:09.698714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.155282 Dec 08 11:41:09.699504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 654/1299] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:09 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:09.774995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:09.775719 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:09.781835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:09.782373 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:09.783258 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:09.783772 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:09.921515 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:09.930021 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:09.931526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:09.932692 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1cb9ad07-4e57-436e-a2e7-11bed112be0d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.161475 Dec 08 11:41:09.933268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 655/1300] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:09 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:10.717193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:10.717852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:10.724151 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:10.724662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:10.725476 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:10.725917 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:10.865325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:10.873265 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-939dddb9-85d3-446e-aedf-3cc7cc537a02 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.159609 Dec 08 11:41:10.873846 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 656/1301] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:10 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:10.950513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:10.951234 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:10.957193 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:10.957660 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:10.958445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:10.958889 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:11.096462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:11.106685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:11.108185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:11.112634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7617bd33-f71a-4a39-acb0-e6b504ce04ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.162537 Dec 08 11:41:11.112878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 657/1302] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:10 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:11.891499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:11.892262 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:11.900326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:11.900778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:11.901865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:11.902662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:12.046042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:12.055459 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-335e100e-b771-444c-90be-6fc96b49f059 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.168516 Dec 08 11:41:12.056387 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 658/1303] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:11 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:12.129726 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:12.130337 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:12.136268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:12.136720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:12.137781 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:12.138224 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:12.277119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:12.285342 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:12.286841 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:12.288032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e64f2602-97a6-4103-a8a0-e3101e2a299e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.162066 Dec 08 11:41:12.289241 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 659/1304] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:12 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:13.074713 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:13.075404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:13.081715 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:13.082167 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:13.082962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:13.083398 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:13.235749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:13.243029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.171950 Dec 08 11:41:13.243589 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 660/1305] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:13 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:13.306787 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:13.307509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:13.313513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:13.313971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:13.314765 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:13.315205 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:13.443820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:13.452117 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:13.453651 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:13.454812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.151780 Dec 08 11:41:13.455367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 661/1306] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:13 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:14.259655 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:14.260314 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:14.266820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:14.267272 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:14.268050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:14.268488 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:14.395063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:14.402286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.146276 Dec 08 11:41:14.402843 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 662/1307] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:14 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:14.472756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:14.473384 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:14.479742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:14.480192 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:14.480968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:14.481438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:14.611931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:14.619469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:14.620968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:14.622140 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.152909 Dec 08 11:41:14.622696 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 663/1308] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:14 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:15.419160 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:15.419790 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:15.425927 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:15.426375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:15.427143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:15.427578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:15.560335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:15.567628 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.152217 Dec 08 11:41:15.568194 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 664/1309] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:15 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:15.639513 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:15.640115 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:15.645681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:15.646128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:15.646902 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:15.647338 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:15.776785 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:15.784440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:15.785972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:15.787132 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8256fdb3-f88b-4458-9fd8-876980a40e94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.151300 Dec 08 11:41:15.787868 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 665/1310] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:15 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:16.301138 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ac40c60f-0ac7-475c-8580-8828256bb637 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action" status: 200 len: 38311 microversion: 2.1 time: 13.264562 Dec 08 11:41:16.301886 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 646/1311] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Dec 8 11:41:03 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/action => generated 38311 bytes in 13266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 08 11:41:16.312096 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:16.312695 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:16.318501 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:16.318946 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:16.320353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:16.320783 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:16.343206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ac20b2bd-2270-428e-8c7e-e5eab3517eda tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/ips" status: 200 len: 146 microversion: 2.1 time: 0.034700 Dec 08 11:41:16.343778 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 666/1312] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Dec 8 11:41:16 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:41:16.593525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:16.593525 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:16.595323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:16.595489 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:16.596751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:16.597281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:16.805358 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:16.806077 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:16.812588 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:16.813123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:16.814004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:16.814514 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:17.000688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:17.007973 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b19ae8aa-99e7-49de-9a68-820f6bacc031 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1569 microversion: 2.1 time: 0.426039 Dec 08 11:41:17.008528 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 647/1313] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:16 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1569 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:17.108030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:17.116039 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:17.117540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:17.118681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.317015 Dec 08 11:41:17.119237 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 667/1314] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:16 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:17.646060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "007689c6-2fed-48de-a623-1e9f1a8b2ebf"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:17.647118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:17.654237 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:17.654697 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:17.655480 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:17.655922 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:17.845452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:41:17.846030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:41:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:41:17.892840 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-072a60c2-d313-4cad-82e5-9b06cc1d6178 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250304 Dec 08 11:41:17.893503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 648/1315] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:41:17 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:18.024926 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:18.025571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:18.032011 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:18.032464 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:18.033278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:18.033898 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:18.137203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:18.138123 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:18.144470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:18.144935 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:18.145835 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:18.146284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:18.170649 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:18.177980 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5c5844af-3c26-44a6-ab92-1fff3563db19 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1450 microversion: 2.1 time: 0.156760 Dec 08 11:41:18.178548 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 668/1316] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:18 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:18.276718 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:18.284500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:18.286013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:18.287218 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b902a0fd-e012-438d-85d0-60a42563dda5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.154547 Dec 08 11:41:18.287755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 649/1317] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:18 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 08 11:41:18.796285 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-9a6316f8-fdb9-41cc-9c4b-cc005efdb51f req-e6ae720e-9c70-476e-b5e6-51997325a5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-deleted", "tag": "79e98205-d459-4886-827e-71b058999e30"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:18.797968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:41:18.797968 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:41:18.805170 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-9a6316f8-fdb9-41cc-9c4b-cc005efdb51f req-e6ae720e-9c70-476e-b5e6-51997325a5bc service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:18.805645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-9a6316f8-fdb9-41cc-9c4b-cc005efdb51f req-e6ae720e-9c70-476e-b5e6-51997325a5bc service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:18.817590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-9a6316f8-fdb9-41cc-9c4b-cc005efdb51f req-e6ae720e-9c70-476e-b5e6-51997325a5bc service nova] Creating event network-vif-deleted:79e98205-d459-4886-827e-71b058999e30 for instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 on hv-cinder-81977 Dec 08 11:41:18.822878 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-9a6316f8-fdb9-41cc-9c4b-cc005efdb51f req-e6ae720e-9c70-476e-b5e6-51997325a5bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030255 Dec 08 11:41:18.823466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 669/1318] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:41:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:19.195891 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:19.196584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:19.204509 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:19.204972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:19.205833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:19.206630 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:19.237140 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:19.237571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:19.238029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lazy-loading 'fault' on Instance uuid 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:41:19.277855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe3782a7d2e48cc922a46faf9c476d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23027f58b51142389f64405702a0fcd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:19.285160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-81c43de3-552a-4520-985c-45aa763a69f5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 200 len: 1225 microversion: 2.1 time: 0.093635 Dec 08 11:41:19.285731 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 650/1319] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:19 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:19.307832 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:19.308556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:19.314607 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:19.315064 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:19.315852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:19.316297 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:19.460958 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:19.468685 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:19.470245 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:19.471402 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-82a80638-d11c-4ab9-b635-388d2620a3be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.169029 Dec 08 11:41:19.471956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 670/1320] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:19 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:20.302757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:20.303296 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] [instance: 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:20.310100 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:20.310570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:20.311362 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:20.311807 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:20.324614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] HTTP exception thrown: Instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 could not be found. Dec 08 11:41:20.325233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Returning 404 to user: Instance 3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:41:20.326050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3a4851a0-cf33-404f-8a1a-03d4cff9a5bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1" status: 404 len: 111 microversion: 2.1 time: 0.027115 Dec 08 11:41:20.326564 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 651/1321] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:20 2021] GET /compute/v2.1/servers/3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:41:20.486735 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-41382fb0-813c-4687-844c-562a4e1eaea9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling method '.version_select at 0x7f1fa66eaee0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:20.490488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:20.491576 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:20.509814 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-41382fb0-813c-4687-844c-562a4e1eaea9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1810756953" status: 202 len: 0 microversion: 2.1 time: 0.028308 Dec 08 11:41:20.510394 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 671/1322] 10.222.0.66 () {58 vars in 1253 bytes} [Wed Dec 8 11:41:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1810756953 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:41:20.517591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:20.517591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:20.517591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:20.517591 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:20.677386 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:20.692763 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:20.694337 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:20.695477 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-060f0521-fd90-4b93-9e26-fd05e915125d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.209589 Dec 08 11:41:20.696026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 652/1323] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:20 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:21.713775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:21.714465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:21.721200 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:21.721659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:21.722495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:21.722887 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:21.882165 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:21.891094 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:21.892630 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:21.893827 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.184304 Dec 08 11:41:21.894393 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 672/1324] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:21 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:22.891194 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-8c83e9ee-849e-4065-abb7-2d7cc72eff45 req-1ef84210-0f52-4f0f-bec6-7773629c0501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:22.894072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:41:22.894072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:41:22.903633 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-8c83e9ee-849e-4065-abb7-2d7cc72eff45 req-1ef84210-0f52-4f0f-bec6-7773629c0501 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:22.904083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-8c83e9ee-849e-4065-abb7-2d7cc72eff45 req-1ef84210-0f52-4f0f-bec6-7773629c0501 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:22.917789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:22.919533 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-8c83e9ee-849e-4065-abb7-2d7cc72eff45 req-1ef84210-0f52-4f0f-bec6-7773629c0501 service nova] Creating event network-vif-plugged:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:41:22.921240 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:22.927316 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-8c83e9ee-849e-4065-abb7-2d7cc72eff45 req-1ef84210-0f52-4f0f-bec6-7773629c0501 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040576 Dec 08 11:41:22.930851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 653/1325] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:22.936056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:22.937216 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:22.938251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:22.938879 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:23.159995 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:23.170030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:23.171771 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:23.172936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6f21b521-387a-4490-883d-e37bdb21545f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.265000 Dec 08 11:41:23.174035 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 673/1326] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:22 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:24.192323 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:24.193026 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:24.199158 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:24.200161 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:24.201474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:24.202083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:24.431034 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:24.439220 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:24.441014 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:24.442500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2fefa21e-06be-4ae5-9846-5310fd25e384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1731 microversion: 2.20 time: 0.254848 Dec 08 11:41:24.453263 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 654/1327] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:24 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:25.412413 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:25.413880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:25.420286 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:25.420750 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:25.421576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:25.422011 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:25.451468 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-0e3648c9-87f2-4b51-bc5e-5ab2ae817a10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Dec 08 11:41:25.451949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 674/1328] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:41:25 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:25.459474 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:25.460204 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:25.461674 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:25.462109 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:25.466538 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:25.467029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:25.467931 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:25.468172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:25.468557 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:25.468802 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:25.469615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:25.470051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:25.501952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-187ed4c2-ae66-4f0c-ad0d-cab02e5991d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/007689c6-2fed-48de-a623-1e9f1a8b2ebf" status: 200 len: 194 microversion: 2.1 time: 0.044015 Dec 08 11:41:25.502680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 675/1329] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Dec 8 11:41:25 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/007689c6-2fed-48de-a623-1e9f1a8b2ebf => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:25.929431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:25.937672 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:25.939228 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:25.940431 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ec2f4714-be9c-4357-aabb-ab8573434387 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1718 microversion: 2.20 time: 0.484605 Dec 08 11:41:25.941201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 655/1330] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:41:25 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1718 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:41:26.853451 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954ff8cc-6397-483c-8a2d-183eaf0a78ab"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:26.854578 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:26.868969 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:26.870029 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:26.870838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:26.871276 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:27.130243 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fef5dc33-1c19-432a-bee6-be9f0fe59abb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284368 Dec 08 11:41:27.130852 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 676/1331] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Dec 8 11:41:26 2021] POST /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:34.612638 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:34.613584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:34.620409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:34.620860 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:34.621676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:34.622118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:34.650994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1e97a319-a304-406a-9b03-c787fe2eaa0e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042070 Dec 08 11:41:34.651541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 656/1332] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:41:34 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:34.854362 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:34.854943 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:34.861027 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:34.861504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:34.862281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:34.862720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:34.890267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ef07f4bd-261c-4bf7-9767-8dc0f91abb5c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/007689c6-2fed-48de-a623-1e9f1a8b2ebf" status: 200 len: 194 microversion: 2.1 time: 0.041164 Dec 08 11:41:34.891393 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 677/1333] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Dec 8 11:41:34 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/007689c6-2fed-48de-a623-1e9f1a8b2ebf => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:34.900483 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:34.901050 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:34.906830 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:34.907279 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:34.908048 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:34.908485 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:34.983417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lazy-loading 'services' on Instance uuid 7f2f2abb-3bae-48d7-a02d-420f509114ca {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:41:35.052262 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-37be32e3-22c3-4cfc-abf3-391c091fc555 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/007689c6-2fed-48de-a623-1e9f1a8b2ebf" status: 202 len: 0 microversion: 2.1 time: 0.155777 Dec 08 11:41:35.052836 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 657/1334] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:41:34 2021] DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/007689c6-2fed-48de-a623-1e9f1a8b2ebf => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:41:36.167149 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:36.167931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:36.173944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:36.174395 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:36.175169 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:36.175599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:36.205111 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d4f89449-fe7d-45af-954c-688e6ee0f8b9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/954ff8cc-6397-483c-8a2d-183eaf0a78ab" status: 200 len: 194 microversion: 2.1 time: 0.042297 Dec 08 11:41:36.205749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 678/1335] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Dec 8 11:41:36 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/954ff8cc-6397-483c-8a2d-183eaf0a78ab => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:36.216707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:36.217321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:36.223339 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:36.223799 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:36.224580 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:36.225018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:36.306132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lazy-loading 'services' on Instance uuid 7f2f2abb-3bae-48d7-a02d-420f509114ca {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:41:36.375438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7b23276f-c4eb-4ce5-8a2c-67fb6c7362ba tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/954ff8cc-6397-483c-8a2d-183eaf0a78ab" status: 202 len: 0 microversion: 2.1 time: 0.163169 Dec 08 11:41:36.376020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 658/1336] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Dec 8 11:41:36 2021] DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments/954ff8cc-6397-483c-8a2d-183eaf0a78ab => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:41:37.524440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:37.525470 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:37.531603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.532052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.532828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.533288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.560743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-62f00ada-d1e5-4bfa-890b-addc55977bf0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040665 Dec 08 11:41:37.561319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 679/1337] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:41:37 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:41:37.658783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:37.659828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:37.665792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.666242 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.667012 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.667446 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.696079 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ea3b46cd-e29c-49f7-b552-f8f3af4060f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041080 Dec 08 11:41:37.696548 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 659/1338] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Dec 8 11:41:37 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 08 11:41:37.748560 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:37.749063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:37.754909 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.755352 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.756122 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.756572 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.780805 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:41:37.852367 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-72743492-cd7e-4b13-a3d6-3614de35cb19 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 204 len: 0 microversion: 2.1 time: 0.107183 Dec 08 11:41:37.852975 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 680/1339] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:41:37 2021] DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:41:37.861327 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:37.861937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:37.868217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.868665 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:37.869471 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:37.869904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:38.005479 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:38.013684 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e2b8bd7d-2c41-4068-82e1-15c1231a220f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1673 microversion: 2.1 time: 0.156142 Dec 08 11:41:38.014246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 660/1340] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:37 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:39.031288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:39.031998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:39.038252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:39.038708 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:39.039998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:39.040440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:39.170540 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:39.178052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1673 microversion: 2.1 time: 0.150823 Dec 08 11:41:39.178619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 681/1341] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:39 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:41:40.196259 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:40.196881 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:40.203448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:40.203984 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:40.204926 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:40.205397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:40.447035 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19df77156f4d40bab9337d27d4301a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:41:40.454221 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0082ee88-ab93-43bf-8049-4690ffd5c333 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 200 len: 1673 microversion: 2.1 time: 0.262309 Dec 08 11:41:40.454987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 661/1342] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:40 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:41.047409 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-94ba1e45-05fc-450d-a7a5-a98a5a1ad31a req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "name": "network-vif-deleted", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:41:41.048953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:41:41.048953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:41:41.055767 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-94ba1e45-05fc-450d-a7a5-a98a5a1ad31a req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:41.056213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-94ba1e45-05fc-450d-a7a5-a98a5a1ad31a req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:41.066550 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-94ba1e45-05fc-450d-a7a5-a98a5a1ad31a req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed service nova] Creating event network-vif-deleted:973b8088-0638-45a6-9fe0-acffa26314d2 for instance 7f2f2abb-3bae-48d7-a02d-420f509114ca on hv-cinder-81977 Dec 08 11:41:41.072238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-94ba1e45-05fc-450d-a7a5-a98a5a1ad31a req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249723 Dec 08 11:41:41.072815 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 682/1343] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:41:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:41.470976 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:41.471506 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:41.477977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:41.478438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:41.479232 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:41.479679 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:41.493414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] HTTP exception thrown: Instance 7f2f2abb-3bae-48d7-a02d-420f509114ca could not be found. Dec 08 11:41:41.494011 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Returning 404 to user: Instance 7f2f2abb-3bae-48d7-a02d-420f509114ca could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:41:41.494833 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a9bc01a2-3ebd-498b-85b7-47b048427976 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 404 len: 111 microversion: 2.1 time: 0.027690 Dec 08 11:41:41.495380 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 662/1344] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:41 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:41:41.504426 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-358b462b-1520-4353-a9ab-6d0809a84b03 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '.version_select at 0x7f1fa67f5550>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:41.524890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-358b462b-1520-4353-a9ab-6d0809a84b03 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099855473" status: 202 len: 0 microversion: 2.1 time: 0.024669 Dec 08 11:41:41.525687 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 683/1345] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Dec 8 11:41:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099855473 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:41:44.392358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:44.392847 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:44.399083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:44.399535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:44.400309 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:44.400750 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:44.413565 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] HTTP exception thrown: Instance 7f2f2abb-3bae-48d7-a02d-420f509114ca could not be found. Dec 08 11:41:44.414650 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Returning 404 to user: Instance 7f2f2abb-3bae-48d7-a02d-420f509114ca could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:41:44.415458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-16db6bb6-72b2-437f-926b-c44d6b2fb0a7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 404 len: 111 microversion: 2.1 time: 0.026738 Dec 08 11:41:44.415965 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 663/1346] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:41:44 2021] DELETE /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:41:44.423594 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:44.424325 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 7f2f2abb-3bae-48d7-a02d-420f509114ca] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:44.431376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:44.431828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:44.432615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:44.433052 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:44.445755 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] HTTP exception thrown: Instance 7f2f2abb-3bae-48d7-a02d-420f509114ca could not be found. Dec 08 11:41:44.446339 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Returning 404 to user: Instance 7f2f2abb-3bae-48d7-a02d-420f509114ca could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:41:44.447142 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6ecfea3c-1283-44e2-adad-36c979d8d6d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca" status: 404 len: 111 microversion: 2.1 time: 0.027222 Dec 08 11:41:44.447648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 684/1347] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:44 2021] GET /compute/v2.1/servers/7f2f2abb-3bae-48d7-a02d-420f509114ca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:41:45.569721 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:45.570223 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:45.576414 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:45.576867 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:45.577689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:45.578132 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:45.591072 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] HTTP exception thrown: Instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 could not be found. Dec 08 11:41:45.591654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Returning 404 to user: Instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:41:45.592454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-20720b0d-f474-4740-ab1f-927bae66ac41 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 404 len: 111 microversion: 2.1 time: 0.026374 Dec 08 11:41:45.592974 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 664/1348] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:41:45 2021] DELETE /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:41:45.600588 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:45.601231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] [instance: 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:41:45.607921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:45.608378 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:45.609185 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:41:45.609633 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:41:45.623134 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] HTTP exception thrown: Instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 could not be found. Dec 08 11:41:45.623748 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Returning 404 to user: Instance 6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:41:45.624555 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-561c4048-fb64-4a90-8a8d-8e78d3c877a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538" status: 404 len: 111 microversion: 2.1 time: 0.027679 Dec 08 11:41:45.625074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 685/1349] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:41:45 2021] GET /compute/v2.1/servers/6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:41:51.442725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-74b0f11d-d144-4e1e-83e8-e160ca499b6e tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa707ff70>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:51.487061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-74b0f11d-d144-4e1e-83e8-e160ca499b6e tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4b40011e-31de-47f5-aff9-232cb6543e1e" status: 200 len: 350 microversion: 2.1 time: 0.047904 Dec 08 11:41:51.487636 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 665/1350] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:41:51 2021] GET /compute/v2.1/os-volumes/4b40011e-31de-47f5-aff9-232cb6543e1e => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:52.779291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bb09780e-5cd8-4542-94b8-24b6988d958a tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa6834700>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:52.825421 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bb09780e-5cd8-4542-94b8-24b6988d958a tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/fbca7f6a-9b23-482e-a985-9156afe54bd1" status: 200 len: 351 microversion: 2.1 time: 0.049575 Dec 08 11:41:52.825979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 686/1351] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:41:52 2021] GET /compute/v2.1/os-volumes/fbca7f6a-9b23-482e-a985-9156afe54bd1 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:54.118911 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c9333cf4-167d-4a94-863c-65962c017655 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa706e820>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.163994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c9333cf4-167d-4a94-863c-65962c017655 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/a4503116-3e69-4295-be44-0e32c9c71bf8" status: 200 len: 351 microversion: 2.1 time: 0.049064 Dec 08 11:41:54.164550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 666/1352] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes/a4503116-3e69-4295-be44-0e32c9c71bf8 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:54.175935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-282e6e13-9e73-48d6-acf2-ff4cbd86a096 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fab416940>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.252981 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-282e6e13-9e73-48d6-acf2-ff4cbd86a096 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081279 Dec 08 11:41:54.253590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 687/1353] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:54.266078 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-85acd4ae-e852-4226-a209-c3b70723caab tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa6da33a0>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.344160 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-85acd4ae-e852-4226-a209-c3b70723caab tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081776 Dec 08 11:41:54.344734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 667/1354] 10.222.0.66 () {58 vars in 1148 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:54.356127 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-58b5e30e-98a1-419a-8835-3bd3c1f06ae9 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fab416820>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.434518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-58b5e30e-98a1-419a-8835-3bd3c1f06ae9 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081872 Dec 08 11:41:54.435079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 688/1355] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:54.446283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f2229877-8e76-4932-a1d2-fc9408adb417 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa6527700>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.522076 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f2229877-8e76-4932-a1d2-fc9408adb417 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.079837 Dec 08 11:41:54.523153 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 668/1356] 10.222.0.66 () {58 vars in 1166 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:54.534378 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-a4fdf90b-e5e0-4cca-8ab1-3ec7861b126a tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa67f5c10>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.610871 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-a4fdf90b-e5e0-4cca-8ab1-3ec7861b126a tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.079937 Dec 08 11:41:54.611435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 689/1357] 10.222.0.66 () {58 vars in 1169 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:54.623372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-5e3a2beb-bc75-49ce-ae50-039a4894aef8 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa63ef670>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.700421 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-5e3a2beb-bc75-49ce-ae50-039a4894aef8 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080597 Dec 08 11:41:54.701746 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 669/1358] 10.222.0.66 () {58 vars in 1154 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:41:54.713438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-b4000f4a-0a40-4b34-8cc0-ac8a52183421 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fab433700>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:54.791979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-b4000f4a-0a40-4b34-8cc0-ac8a52183421 tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082388 Dec 08 11:41:54.792531 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 690/1359] 10.222.0.66 () {58 vars in 1187 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:41:54.806500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2a1c3572-5afb-4bbf-9451-08cb893e52cd tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] Calling method '.version_select at 0x7f1fa640d160>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:41:55.030424 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2a1c3572-5afb-4bbf-9451-08cb893e52cd tempest-VolumesTestJSON-314023695 tempest-VolumesTestJSON-314023695-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.229669 Dec 08 11:41:55.030994 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 670/1360] 10.222.0.66 () {58 vars in 1154 bytes} [Wed Dec 8 11:41:54 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:42:14.245759 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:42:14.246451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:42:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:42:21.513326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:21.513326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:21.519452 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:21.519914 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:21.520701 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:21.521173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:21.550982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f684ea94-e202-44b3-83b6-95e3f8c8a296 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044135 Dec 08 11:42:21.551614 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 691/1361] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Dec 8 11:42:21 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:42:21.609540 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:21.610118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:21.615937 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:21.616391 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:21.617224 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:21.617671 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:21.642541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:42:21.719846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d8ec7ac5-304f-4135-82d0-20ee177fd347 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 204 len: 0 microversion: 2.20 time: 0.116345 Dec 08 11:42:21.720433 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 671/1362] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Dec 8 11:42:21 2021] DELETE /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 08 11:42:21.728399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:21.729017 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:21.734891 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:21.735344 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:21.736125 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:21.736565 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:21.876583 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:21.884580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:21.886837 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:21.888294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.163692 Dec 08 11:42:21.888845 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 692/1363] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:42:21 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:42:22.907458 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:22.908089 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:22.914248 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:22.914695 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:22.915476 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:22.915912 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:23.053118 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:23.060893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:23.062436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:23.063604 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7dac6076-4514-4483-ba0f-6b7248f45548 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1724 microversion: 2.20 time: 0.160192 Dec 08 11:42:23.064342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 672/1364] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:42:22 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:42:24.086553 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:24.094626 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:24.100897 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:24.101652 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:24.102522 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:24.103033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:24.158413 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-065e5b04-63db-4672-a5f7-45f10c604d7f req-4a76046d-f958-41c4-b5cd-9d7b528c71cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-deleted", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:42:24.173641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:42:24.173641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:42:24.189826 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-065e5b04-63db-4672-a5f7-45f10c604d7f req-4a76046d-f958-41c4-b5cd-9d7b528c71cf service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:24.190286 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-065e5b04-63db-4672-a5f7-45f10c604d7f req-4a76046d-f958-41c4-b5cd-9d7b528c71cf service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:24.213338 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-065e5b04-63db-4672-a5f7-45f10c604d7f req-4a76046d-f958-41c4-b5cd-9d7b528c71cf service nova] Creating event network-vif-deleted:d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee for instance 20f4bc10-4a61-47a6-857a-48e682893ae3 on hv-cinder-81977 Dec 08 11:42:24.213743 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:24.225869 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-065e5b04-63db-4672-a5f7-45f10c604d7f req-4a76046d-f958-41c4-b5cd-9d7b528c71cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069058 Dec 08 11:42:24.226227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:24.226530 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 673/1365] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:42:24.228220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c73027d527c3484985868045e24272e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:42:24.231270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dc3f5725-d231-477a-b66e-e311f0d9aece tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 200 len: 1656 microversion: 2.20 time: 0.152667 Dec 08 11:42:24.235835 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 693/1366] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:42:24 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 08 11:42:25.254353 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:25.255043 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:25.261601 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:25.262315 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:25.263090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:25.263527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:25.278979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] HTTP exception thrown: Instance 20f4bc10-4a61-47a6-857a-48e682893ae3 could not be found. Dec 08 11:42:25.279597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Returning 404 to user: Instance 20f4bc10-4a61-47a6-857a-48e682893ae3 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:25.280438 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b53ab906-b021-4fba-a3a1-ebf64bee43ce tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 404 len: 111 microversion: 2.20 time: 0.030555 Dec 08 11:42:25.281205 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 674/1367] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Dec 8 11:42:25 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 08 11:42:25.289562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3841ba0d-b9d3-4c0e-91ab-9384ba8f8500 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '.version_select at 0x7f1fa66c7670>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:25.306105 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3841ba0d-b9d3-4c0e-91ab-9384ba8f8500 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005935368" status: 204 len: 0 microversion: 2.20 time: 0.020153 Dec 08 11:42:25.306670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 694/1368] 10.222.0.66 () {60 vars in 1261 bytes} [Wed Dec 8 11:42:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005935368 => generated 0 bytes in 21 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 08 11:42:27.072233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:27.072756 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:27.079018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:27.079337 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:27.080206 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:27.080654 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:27.094783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] HTTP exception thrown: Instance 20f4bc10-4a61-47a6-857a-48e682893ae3 could not be found. Dec 08 11:42:27.095407 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Returning 404 to user: Instance 20f4bc10-4a61-47a6-857a-48e682893ae3 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:27.096404 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-06b884d8-00ea-47e2-9426-0b1da8ee7921 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 404 len: 111 microversion: 2.1 time: 0.027786 Dec 08 11:42:27.097020 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 675/1369] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:42:27 2021] DELETE /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:27.107151 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:27.107858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 20f4bc10-4a61-47a6-857a-48e682893ae3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:27.114590 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:27.115042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:27.115825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:27.116279 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:27.130771 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] HTTP exception thrown: Instance 20f4bc10-4a61-47a6-857a-48e682893ae3 could not be found. Dec 08 11:42:27.131363 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Returning 404 to user: Instance 20f4bc10-4a61-47a6-857a-48e682893ae3 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:27.132247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-58081f71-06a1-41c1-93a1-a3e4a8fd75b8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3" status: 404 len: 111 microversion: 2.1 time: 0.031067 Dec 08 11:42:27.132776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 695/1370] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:42:27 2021] GET /compute/v2.1/servers/20f4bc10-4a61-47a6-857a-48e682893ae3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 08 11:42:28.266376 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:28.266875 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:28.273142 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:28.273625 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:28.274396 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:28.274828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:28.287618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] HTTP exception thrown: Instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f could not be found. Dec 08 11:42:28.288196 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Returning 404 to user: Instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:28.288992 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-d68341c3-4b6f-48f1-a7ff-053162756792 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 404 len: 111 microversion: 2.1 time: 0.026265 Dec 08 11:42:28.289597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 676/1371] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:42:28 2021] DELETE /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:28.297599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:28.298217 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] [instance: 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:42:28.304438 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:28.304890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:28.305694 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:42:28.306163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:42:28.319545 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] HTTP exception thrown: Instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f could not be found. Dec 08 11:42:28.320121 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Returning 404 to user: Instance 2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:28.320936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ec14a71d-6c05-484f-8180-adc05afb5cc7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f" status: 404 len: 111 microversion: 2.1 time: 0.026988 Dec 08 11:42:28.321480 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 696/1372] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:42:28 2021] GET /compute/v2.1/servers/2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 08 11:42:32.888592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-13b80d1a-9706-48a8-b1e5-f8e1ea528894 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Action: 'create', calling method: .version_select at 0x7f1fa6fff5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1472247332"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:42:33.181640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-13b80d1a-9706-48a8-b1e5-f8e1ea528894 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.413598 Dec 08 11:42:33.182337 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 677/1373] 10.222.0.66 () {60 vars in 1154 bytes} [Wed Dec 8 11:42:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 08 11:42:33.197792 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-14ebd6f6-c29e-4b62-b1fa-69733f9447b6 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fab433160>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:33.264923 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-14ebd6f6-c29e-4b62-b1fa-69733f9447b6 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 200 len: 345 microversion: 2.1 time: 0.070957 Dec 08 11:42:33.265518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 697/1374] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:42:33 2021] GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:34.278243 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7f7f1cc1-62a1-448e-947b-2b689592c35a tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa7040a60>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:34.324945 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7f7f1cc1-62a1-448e-947b-2b689592c35a tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 200 len: 346 microversion: 2.1 time: 0.050769 Dec 08 11:42:34.325549 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 678/1375] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:42:34 2021] GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:34.336613 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-036e91aa-7a38-4c82-90d6-cb22ac0dd440 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Action: 'create', calling method: .version_select at 0x7f1fa67f54c0>, body: {"snapshot": {"volume_id": "030cf59f-3d49-47e7-80ae-6ce6817a7eee", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-919253735"}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:42:34.474698 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-036e91aa-7a38-4c82-90d6-cb22ac0dd440 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.142092 Dec 08 11:42:34.475269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 698/1376] 10.222.0.66 () {60 vars in 1161 bytes} [Wed Dec 8 11:42:34 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:42:34.485361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1eef9d27-f72c-4c49-b077-9e37d4df30e2 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa6de9670>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:34.516894 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1eef9d27-f72c-4c49-b077-9e37d4df30e2 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.035217 Dec 08 11:42:34.517539 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 679/1377] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:34 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:34.526945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-54d7b55b-9cb2-45dc-82e5-ecf5a0c3803e tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fab4151f0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:34.554571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-54d7b55b-9cb2-45dc-82e5-ecf5a0c3803e tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031262 Dec 08 11:42:34.555129 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 699/1378] 10.222.0.66 () {58 vars in 1139 bytes} [Wed Dec 8 11:42:34 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:34.565178 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ad8a274c-e163-4b39-92c0-230f9d7299ad tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa6dea940>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:34.594213 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ad8a274c-e163-4b39-92c0-230f9d7299ad tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.032511 Dec 08 11:42:34.595018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 680/1379] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:34 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:35.605664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-37608e21-121d-4af6-8d3b-96e5d35e9bc4 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa66ea5e0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:35.634606 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-37608e21-121d-4af6-8d3b-96e5d35e9bc4 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.032991 Dec 08 11:42:35.635412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 700/1380] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:35 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:36.647428 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4058c4a5-a9ca-44df-8ce7-f7421918968c tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa7059700>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:36.676099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4058c4a5-a9ca-44df-8ce7-f7421918968c tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.032699 Dec 08 11:42:36.676642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 681/1381] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:36 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:37.688095 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c296a6bf-04f1-43da-9088-143ecd552cd8 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fab460160>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:37.717448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c296a6bf-04f1-43da-9088-143ecd552cd8 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.033392 Dec 08 11:42:37.717998 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 701/1382] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:37 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:38.729394 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ff6e892e-d4f8-4385-9d82-19ab85df1654 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa7059820>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:38.758334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ff6e892e-d4f8-4385-9d82-19ab85df1654 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.033073 Dec 08 11:42:38.758892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 682/1383] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:38 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:39.770644 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-345ccd85-1c0e-42e2-8132-3df13e2f519c tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa6725f70>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:39.798956 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-345ccd85-1c0e-42e2-8132-3df13e2f519c tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 287 microversion: 2.1 time: 0.032402 Dec 08 11:42:39.799493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 702/1384] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:39 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:39.810218 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-9b036838-a3a7-440e-89f5-675da8c692ef tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa6fa93a0>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:39.863828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-9b036838-a3a7-440e-89f5-675da8c692ef tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 202 len: 0 microversion: 2.1 time: 0.058114 Dec 08 11:42:39.865004 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 683/1385] 10.222.0.66 () {58 vars in 1253 bytes} [Wed Dec 8 11:42:39 2021] DELETE /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:42:39.874672 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6d72eb45-e80b-4d42-94ab-44358cf47d37 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fab433940>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:39.903429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6d72eb45-e80b-4d42-94ab-44358cf47d37 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 200 len: 286 microversion: 2.1 time: 0.033153 Dec 08 11:42:39.903993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 703/1386] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:39 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:40.915614 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2da173c3-584d-4e19-b85d-9508a455012d tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa6fa6820>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:40.939859 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-2da173c3-584d-4e19-b85d-9508a455012d tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] HTTP exception thrown: Snapshot f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 could not be found. Dec 08 11:42:40.940490 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2da173c3-584d-4e19-b85d-9508a455012d tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Returning 404 to user: Snapshot f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:40.941342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2da173c3-584d-4e19-b85d-9508a455012d tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97" status: 404 len: 111 microversion: 2.1 time: 0.029844 Dec 08 11:42:40.941873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 684/1387] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Dec 8 11:42:40 2021] GET /compute/v2.1/os-snapshots/f22a7dfd-5cc5-46a3-a0eb-a75763ef3f97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:40.950603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-53ee77bc-2a9c-4c04-a374-0c98601bfefc tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fab460790>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:41.006382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-53ee77bc-2a9c-4c04-a374-0c98601bfefc tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 202 len: 0 microversion: 2.1 time: 0.060290 Dec 08 11:42:41.007465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 704/1388] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Dec 8 11:42:40 2021] DELETE /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:42:41.015618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7a09adc6-3671-44d1-b3e1-1d53922c4e0c tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa6fa6ee0>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:41.060187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7a09adc6-3671-44d1-b3e1-1d53922c4e0c tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 200 len: 345 microversion: 2.1 time: 0.048449 Dec 08 11:42:41.060765 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 685/1389] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:42:41 2021] GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:42:42.071908 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-10e0ac1b-cd0a-4eb6-b2c0-b82501e7b982 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fab433940>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:42.098441 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-10e0ac1b-cd0a-4eb6-b2c0-b82501e7b982 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] HTTP exception thrown: Volume 030cf59f-3d49-47e7-80ae-6ce6817a7eee could not be found. Dec 08 11:42:42.099032 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-10e0ac1b-cd0a-4eb6-b2c0-b82501e7b982 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Returning 404 to user: Volume 030cf59f-3d49-47e7-80ae-6ce6817a7eee could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:42.099848 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-10e0ac1b-cd0a-4eb6-b2c0-b82501e7b982 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 404 len: 109 microversion: 2.1 time: 0.032132 Dec 08 11:42:42.100379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 705/1390] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:42:42 2021] GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:42.110124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-22a190a3-41d5-437c-aef0-41a741002461 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa640d9d0>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:42.136042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-22a190a3-41d5-437c-aef0-41a741002461 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] HTTP exception thrown: Volume 030cf59f-3d49-47e7-80ae-6ce6817a7eee could not be found. Dec 08 11:42:42.137449 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-22a190a3-41d5-437c-aef0-41a741002461 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Returning 404 to user: Volume 030cf59f-3d49-47e7-80ae-6ce6817a7eee could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:42.138776 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-22a190a3-41d5-437c-aef0-41a741002461 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 404 len: 109 microversion: 2.1 time: 0.032382 Dec 08 11:42:42.139403 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 686/1391] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Dec 8 11:42:42 2021] DELETE /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:42.148740 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2ec34cc2-4884-4fd2-8982-d4bdaa577eb9 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Calling method '.version_select at 0x7f1fa66c7790>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:42.175813 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-2ec34cc2-4884-4fd2-8982-d4bdaa577eb9 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] HTTP exception thrown: Volume 030cf59f-3d49-47e7-80ae-6ce6817a7eee could not be found. Dec 08 11:42:42.176408 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-2ec34cc2-4884-4fd2-8982-d4bdaa577eb9 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] Returning 404 to user: Volume 030cf59f-3d49-47e7-80ae-6ce6817a7eee could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:42.177277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-2ec34cc2-4884-4fd2-8982-d4bdaa577eb9 tempest-VolumesSnapshotsTestJSON-1606608746 tempest-VolumesSnapshotsTestJSON-1606608746-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee" status: 404 len: 109 microversion: 2.1 time: 0.032146 Dec 08 11:42:42.177834 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 706/1392] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:42:42 2021] GET /compute/v2.1/os-volumes/030cf59f-3d49-47e7-80ae-6ce6817a7eee => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:43.506915 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-86fff0f3-4d81-4569-8276-5edac03b9c42 tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Action: 'create', calling method: .version_select at 0x7f1fa6e854c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1799005829", "metadata": {"Type": "work"}}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:42:43.508272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-86fff0f3-4d81-4569-8276-5edac03b9c42 tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:43.509097 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-86fff0f3-4d81-4569-8276-5edac03b9c42 tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.110302 Dec 08 11:42:43.509645 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 687/1393] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Dec 8 11:42:43 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 08 11:42:43.519133 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-80c19550-d6dd-4681-8cf0-9cd834b5694d tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Action: 'create', calling method: .version_select at 0x7f1fab460280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-881460945", "metadata": {"Type": "work"}}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:42:43.520556 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-80c19550-d6dd-4681-8cf0-9cd834b5694d tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:43.521435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-80c19550-d6dd-4681-8cf0-9cd834b5694d tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006309 Dec 08 11:42:43.521919 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 707/1394] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Dec 8 11:42:43 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 08 11:42:43.530924 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0e144261-68ff-4503-970d-ec00e23e757b tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Action: 'create', calling method: .version_select at 0x7f1fa6fa9d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1311099386", "metadata": {"Type": "work"}}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:42:43.532087 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-0e144261-68ff-4503-970d-ec00e23e757b tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:43.532873 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-0e144261-68ff-4503-970d-ec00e23e757b tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006112 Dec 08 11:42:43.533397 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 688/1395] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Dec 8 11:42:43 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 08 11:42:43.541736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-db8beda0-e30e-4a4a-98ee-3830605ea4fe tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Calling method '.version_select at 0x7f1fa66ea5e0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:43.569328 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-db8beda0-e30e-4a4a-98ee-3830605ea4fe tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] HTTP exception thrown: Volume tempest-invalid-1606370997 could not be found. Dec 08 11:42:43.570103 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-db8beda0-e30e-4a4a-98ee-3830605ea4fe tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Returning 404 to user: Volume tempest-invalid-1606370997 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:43.570922 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-db8beda0-e30e-4a4a-98ee-3830605ea4fe tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1606370997" status: 404 len: 99 microversion: 2.1 time: 0.033173 Dec 08 11:42:43.571493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 708/1396] 10.222.0.66 () {58 vars in 1217 bytes} [Wed Dec 8 11:42:43 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1606370997 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 08 11:42:43.580310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-db60594c-89a8-4269-a116-c3a2c6c14c74 tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003535 Dec 08 11:42:43.580805 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 689/1397] 10.222.0.66 () {58 vars in 1139 bytes} [Wed Dec 8 11:42:43 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 08 11:42:43.589518 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-db05b6bc-1ae2-4030-9e3e-1543f6a8e2b7 tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003474 Dec 08 11:42:43.590033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 709/1398] 10.222.0.66 () {58 vars in 1136 bytes} [Wed Dec 8 11:42:43 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 08 11:42:43.599916 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1dd1d6e8-cd68-4b69-8602-3c956ea55fcd tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Calling method '.version_select at 0x7f1fa6dc75e0>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:43.625175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-1dd1d6e8-cd68-4b69-8602-3c956ea55fcd tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] HTTP exception thrown: Volume 8be073d1-10e3-48a1-9b6e-a7ca9cbb416e could not be found. Dec 08 11:42:43.625828 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1dd1d6e8-cd68-4b69-8602-3c956ea55fcd tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Returning 404 to user: Volume 8be073d1-10e3-48a1-9b6e-a7ca9cbb416e could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:43.626662 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1dd1d6e8-cd68-4b69-8602-3c956ea55fcd tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/8be073d1-10e3-48a1-9b6e-a7ca9cbb416e" status: 404 len: 109 microversion: 2.1 time: 0.031854 Dec 08 11:42:43.627208 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 690/1399] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Dec 8 11:42:43 2021] DELETE /compute/v2.1/os-volumes/8be073d1-10e3-48a1-9b6e-a7ca9cbb416e => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:43.636097 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5ea8c8cb-1ab8-4f25-9e7e-ce9a21bc252f tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Calling method '.version_select at 0x7f1fab416dc0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:42:43.662374 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-5ea8c8cb-1ab8-4f25-9e7e-ce9a21bc252f tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] HTTP exception thrown: Volume 45e57f3c-d790-4b5a-9e44-45757e43ac3d could not be found. Dec 08 11:42:43.663053 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-5ea8c8cb-1ab8-4f25-9e7e-ce9a21bc252f tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] Returning 404 to user: Volume 45e57f3c-d790-4b5a-9e44-45757e43ac3d could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:42:43.663983 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-5ea8c8cb-1ab8-4f25-9e7e-ce9a21bc252f tempest-VolumesNegativeTest-1523254252 tempest-VolumesNegativeTest-1523254252-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/45e57f3c-d790-4b5a-9e44-45757e43ac3d" status: 404 len: 109 microversion: 2.1 time: 0.031487 Dec 08 11:42:43.664598 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 710/1400] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Dec 8 11:42:43 2021] GET /compute/v2.1/os-volumes/45e57f3c-d790-4b5a-9e44-45757e43ac3d => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:42:51.231206 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:42:51.231862 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:42:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:43:42.838488 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1420471465", "imageRef": "9bf80dba-6633-4859-b75d-e116388524ec", "flavorRef": "452"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:43:42.886448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] validate_networks() for None {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:43:43.432615 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:43:43.433055 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:43:43.433571 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:43:43.433989 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:43:43.434410 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:43:43.443934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:43.444393 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:43.445246 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:43.445774 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:43.463340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Getting quotas for project 6aba8d1c389c4b30b9e9d118d99c8c26. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:43:43.467921 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Getting quotas for user adf86a9d5d9649f3a9ab12dbf132e201 and project 6aba8d1c389c4b30b9e9d118d99c8c26. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:43:43.478803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:43:43.481165 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9bf80dba-6633-4859-b75d-e116388524ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:43:43.525009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-98780063-be02-42b1-a188-998b40b5a7e4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692078 Dec 08 11:43:43.525682 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 691/1401] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:43:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:43:43.536597 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-751d2824-162d-4854-ad1e-b2696f23ae17 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:43.537416 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-751d2824-162d-4854-ad1e-b2696f23ae17 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:43.588624 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-751d2824-162d-4854-ad1e-b2696f23ae17 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:43.595689 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-751d2824-162d-4854-ad1e-b2696f23ae17 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1215 microversion: 2.1 time: 0.063448 Dec 08 11:43:43.596313 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 711/1402] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:43 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:43:44.612846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:44.613500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:44.620651 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:44.621275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:44.622334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:44.622904 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:44.700164 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:44.709982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1273 microversion: 2.1 time: 0.101050 Dec 08 11:43:44.710544 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 692/1403] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:44 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:45.727050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:45.728347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:45.736289 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:45.736740 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:45.737589 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:45.738172 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:45.954950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:45.970312 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9e083da0-92b9-454d-a761-4341b0ce3720 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1315 microversion: 2.1 time: 0.246843 Dec 08 11:43:45.975123 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 712/1404] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:45 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:46.037334 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-b89ee826-eeb6-472b-8b5b-44fa657d6188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:43:46.040649 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:43:46.040649 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:43:46.052010 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-9b309bcf-6f61-4c78-a932-216d4036580a req-b89ee826-eeb6-472b-8b5b-44fa657d6188 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:46.053349 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-9b309bcf-6f61-4c78-a932-216d4036580a req-b89ee826-eeb6-472b-8b5b-44fa657d6188 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:46.081138 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-9b309bcf-6f61-4c78-a932-216d4036580a req-b89ee826-eeb6-472b-8b5b-44fa657d6188 service nova] Creating event network-changed:8e997973-70c0-4a18-88a4-6987a0a07c03 for instance 93a3b4bc-2fd2-4906-b48d-8a83e07d267f on hv-cinder-81977 Dec 08 11:43:46.099007 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-9b309bcf-6f61-4c78-a932-216d4036580a req-b89ee826-eeb6-472b-8b5b-44fa657d6188 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067545 Dec 08 11:43:46.099696 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 693/1405] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:43:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:43:46.991466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:46.992776 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:46.999258 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:46.999714 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:47.000503 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:47.000971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:47.143800 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:47.151279 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-1ed33a1a-25b4-4a48-a88c-b3316016494b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1315 microversion: 2.1 time: 0.163413 Dec 08 11:43:47.151864 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 713/1406] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:46 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:48.169838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:48.170573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:48.176825 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:48.177353 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:48.178128 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:48.178669 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:48.314832 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:48.322092 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1315 microversion: 2.1 time: 0.157800 Dec 08 11:43:48.322646 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 694/1407] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:48 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:49.338876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:49.339424 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:49.346375 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:49.346831 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:49.348040 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:49.348519 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:49.481229 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:49.489016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-7a765e20-70cf-41fa-996e-655aba623302 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1315 microversion: 2.1 time: 0.154001 Dec 08 11:43:49.489619 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 714/1408] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:49 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:50.505964 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:50.506582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:50.512790 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:50.513452 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:50.514154 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:50.514597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:50.646214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:50.654063 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-43997d44-b643-4dd1-97e0-320b6b05ebe8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1315 microversion: 2.1 time: 0.151067 Dec 08 11:43:50.654659 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 695/1409] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:50 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:43:51.255447 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-b68ed7bd-3a60-4b33-aa88-bb73367a258f req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "name": "network-vif-plugged", "status": "completed", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:43:51.257170 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:43:51.257170 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:43:51.264431 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-b68ed7bd-3a60-4b33-aa88-bb73367a258f req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:51.264876 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-b68ed7bd-3a60-4b33-aa88-bb73367a258f req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:51.275622 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-b68ed7bd-3a60-4b33-aa88-bb73367a258f req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 service nova] Creating event network-vif-plugged:8e997973-70c0-4a18-88a4-6987a0a07c03 for instance 93a3b4bc-2fd2-4906-b48d-8a83e07d267f on hv-cinder-81977 Dec 08 11:43:51.280937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-b68ed7bd-3a60-4b33-aa88-bb73367a258f req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029284 Dec 08 11:43:51.281551 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 715/1410] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:43:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:43:51.670511 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:51.671134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:51.677342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:51.677803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:51.679765 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:51.680254 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:51.881846 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:51.893090 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-70c23ba4-423d-4269-87b8-1f8c333292d3 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1315 microversion: 2.1 time: 0.226133 Dec 08 11:43:51.894042 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 696/1411] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:51 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:52.910410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:52.911245 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:52.917985 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:52.918437 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:52.919215 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:52.919684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:53.080445 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:53.097931 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1465 microversion: 2.1 time: 0.191329 Dec 08 11:43:53.098646 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 716/1412] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:52 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1465 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:43:53.134935 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:53.135451 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:53.143008 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:53.143468 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:53.144267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:53.144709 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:53.169687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Going to try to terminate instance {{(pid=117269) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:43:53.246573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1851213b-ba42-4b04-81de-0293a5367df8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "DELETE /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 204 len: 0 microversion: 2.1 time: 0.115014 Dec 08 11:43:53.247234 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 697/1413] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:43:53 2021] DELETE /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:43:53.256043 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:53.256654 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:53.262681 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:53.263134 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:53.264509 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:53.264945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:53.406694 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:53.424801 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ee29de37-69f1-451d-8f05-db0330e17a7b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1471 microversion: 2.1 time: 0.172377 Dec 08 11:43:53.425417 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 717/1414] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:53 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:54.442212 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:54.443096 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:54.449340 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:54.449790 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:54.450566 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:54.451000 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:54.600241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:54.609058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-491853c9-78bf-4305-8e2b-ae547409173f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1471 microversion: 2.1 time: 0.170681 Dec 08 11:43:54.609920 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 698/1415] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:54 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:55.236276 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-cd920b92-a546-42a9-a12c-3836a4790baf req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "name": "network-vif-deleted", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:43:55.239033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:43:55.239033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:43:55.261404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-cd920b92-a546-42a9-a12c-3836a4790baf req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:55.265928 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-cd920b92-a546-42a9-a12c-3836a4790baf req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:55.300109 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-cd920b92-a546-42a9-a12c-3836a4790baf req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 service nova] Creating event network-vif-deleted:8e997973-70c0-4a18-88a4-6987a0a07c03 for instance 93a3b4bc-2fd2-4906-b48d-8a83e07d267f on hv-cinder-81977 Dec 08 11:43:55.316505 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-cd920b92-a546-42a9-a12c-3836a4790baf req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083945 Dec 08 11:43:55.317347 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 718/1416] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:43:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:43:55.633641 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:55.634305 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:55.644185 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:55.644647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:55.645469 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:55.645910 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:55.692841 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:55.693688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:55.694373 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.objects.instance [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lazy-loading 'fault' on Instance uuid 93a3b4bc-2fd2-4906-b48d-8a83e07d267f {{(pid=117269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:43:55.735272 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf86a9d5d9649f3a9ab12dbf132e201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aba8d1c389c4b30b9e9d118d99c8c26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:43:55.744893 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-e5e3a1f0-4061-4e69-8a54-26e8a912529f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 200 len: 1305 microversion: 2.1 time: 0.121146 Dec 08 11:43:55.755342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 699/1417] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:55 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:43:56.775886 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:43:56.782326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] [instance: 93a3b4bc-2fd2-4906-b48d-8a83e07d267f] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:43:56.790860 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:56.791316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:56.792890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:43:56.793466 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:43:56.808294 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] HTTP exception thrown: Instance 93a3b4bc-2fd2-4906-b48d-8a83e07d267f could not be found. Dec 08 11:43:56.809143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Returning 404 to user: Instance 93a3b4bc-2fd2-4906-b48d-8a83e07d267f could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:43:56.809993 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-57d0f47a-b4d7-42d6-90c0-491eb2ce0998 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f" status: 404 len: 111 microversion: 2.1 time: 0.042539 Dec 08 11:43:56.810591 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 719/1418] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:43:56 2021] GET /compute/v2.1/servers/93a3b4bc-2fd2-4906-b48d-8a83e07d267f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:44:02.733603 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-483aa516-e320-4bc4-8f1e-ac1dfdd989ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Action: 'create', calling method: .version_select at 0x7f1fa707fe50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1445011975"}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:44:02.747249 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-483aa516-e320-4bc4-8f1e-ac1dfdd989ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for project 8cd51b040b7242d084a290de749786b8. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:44:02.750827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-483aa516-e320-4bc4-8f1e-ac1dfdd989ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for user 60a663b7e4824df3af38eab2851d2d2c and project 8cd51b040b7242d084a290de749786b8. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:44:02.878762 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-483aa516-e320-4bc4-8f1e-ac1dfdd989ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for project 8cd51b040b7242d084a290de749786b8. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:44:02.882889 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-483aa516-e320-4bc4-8f1e-ac1dfdd989ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for user 60a663b7e4824df3af38eab2851d2d2c and project 8cd51b040b7242d084a290de749786b8. Resources: {'key_pairs'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:44:02.898568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-483aa516-e320-4bc4-8f1e-ac1dfdd989ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.346997 Dec 08 11:44:02.899178 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 700/1419] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Dec 8 11:44:02 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:27.391281 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-125245366", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1445011975", "security_groups": [{"name": "tempest-secgroup-smoke-1598406315"}], "block_device_mapping_v2": [{"uuid": "6631c4d6-d3ed-4f92-bf48-fd91dee28c17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6155a6c-7a89-4b5b-b3cb-d77c93560254"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:44:27.498435 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] validate_networks() for [('b6155a6c-7a89-4b5b-b3cb-d77c93560254', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:44:27.944462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:44:27.944890 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:44:27.945408 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:44:27.945823 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:44:27.946238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:44:27.955724 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:27.956175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:27.956992 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:27.957483 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:27.973320 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for project 8cd51b040b7242d084a290de749786b8. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:44:27.977204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for user 60a663b7e4824df3af38eab2851d2d2c and project 8cd51b040b7242d084a290de749786b8. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:44:28.031079 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:44:28.033213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6631c4d6-d3ed-4f92-bf48-fd91dee28c17',volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:44:28.156198 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769176 Dec 08 11:44:28.156833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 720/1420] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:44:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:44:28.166375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c1ba4885-dbd6-484f-9652-de4b52371984 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:28.166991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c1ba4885-dbd6-484f-9652-de4b52371984 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:28.233839 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c1ba4885-dbd6-484f-9652-de4b52371984 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:28.241031 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c1ba4885-dbd6-484f-9652-de4b52371984 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1094 microversion: 2.1 time: 0.078191 Dec 08 11:44:28.241607 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 701/1421] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:28 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:29.258257 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:29.258877 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:29.265410 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:29.265938 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:29.266798 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:29.267151 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:29.338251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:29.345361 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e27b9191-7a07-4457-abda-9066d6b67abc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1210 microversion: 2.1 time: 0.091189 Dec 08 11:44:29.345954 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 721/1422] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:29 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:30.362201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:30.363688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:30.371119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:30.371583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:30.372437 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:30.372884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:30.570448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-c070543c-c007-425d-b8be-994258d62a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:44:30.572648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:44:30.572648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:44:30.588733 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-c070543c-c007-425d-b8be-994258d62a55 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:30.589580 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-c070543c-c007-425d-b8be-994258d62a55 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:30.602713 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-c070543c-c007-425d-b8be-994258d62a55 service nova] Creating event network-changed:68177bf4-695b-4333-8e9c-95704a3235a4 for instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 on hv-cinder-81977 Dec 08 11:44:30.608820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-c070543c-c007-425d-b8be-994258d62a55 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042858 Dec 08 11:44:30.609635 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 722/1423] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:44:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:44:30.616059 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:30.641900 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.283257 Dec 08 11:44:30.652647 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 702/1424] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:30 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:31.661042 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:31.661688 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:31.667756 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:31.668213 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:31.669645 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:31.670085 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:31.799520 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:31.806690 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-791323ee-96cd-4f0c-a85f-fa78de917607 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.150163 Dec 08 11:44:31.807249 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 723/1425] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:31 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:32.823187 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:32.823792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:32.830808 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:32.831267 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:32.832060 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:32.832499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:32.961092 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:32.968304 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.148649 Dec 08 11:44:32.968871 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 703/1426] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:32 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:33.984783 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:33.985487 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:33.991737 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:33.992173 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:33.992950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:33.993405 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:34.125880 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:34.133090 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-38e1e1f6-9d57-48de-8452-d6d272344251 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.151951 Dec 08 11:44:34.133684 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 724/1427] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:33 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:35.149473 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:35.150085 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:35.156337 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:35.156783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:35.157585 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:35.158022 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:35.287725 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:35.294903 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.149063 Dec 08 11:44:35.295454 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 704/1428] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:35 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:36.311820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:36.312425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:36.318615 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:36.319063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:36.319830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:36.320269 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:36.452882 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:36.460143 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.152536 Dec 08 11:44:36.460734 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 725/1429] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:36 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:37.475972 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:37.476496 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:37.485570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:37.486083 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:37.486883 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:37.487336 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:37.619939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:37.627613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.155448 Dec 08 11:44:37.628174 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 705/1430] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:37 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:38.644231 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:38.644949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:38.650847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:38.651293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:38.652066 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:38.652496 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:38.781528 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:38.788643 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.148095 Dec 08 11:44:38.789404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 726/1431] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:38 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:39.805229 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:39.805857 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:39.812251 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:39.812708 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:39.813526 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:39.813968 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:39.947061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:39.954803 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-4c776a00-687d-4564-a1b8-2b5c2300fe36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.153288 Dec 08 11:44:39.955372 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 706/1432] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:39 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:40.971382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:40.971925 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:40.978319 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:40.978799 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:40.979605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:40.980036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:41.110884 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:41.118102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.150514 Dec 08 11:44:41.118653 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 727/1433] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:40 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:41.539464 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-cea66637-4617-4964-98df-87bad7142fde req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "name": "network-vif-plugged", "status": "completed", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:44:41.540987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:44:41.540987 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:44:41.551643 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-cea66637-4617-4964-98df-87bad7142fde req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:41.552088 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-cea66637-4617-4964-98df-87bad7142fde req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:41.567284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-cea66637-4617-4964-98df-87bad7142fde req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c service nova] Creating event network-vif-plugged:68177bf4-695b-4333-8e9c-95704a3235a4 for instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 on hv-cinder-81977 Dec 08 11:44:41.572319 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-cea66637-4617-4964-98df-87bad7142fde req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092739 Dec 08 11:44:41.572838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 707/1434] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:44:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:44:42.134534 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:42.135141 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:42.142267 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:42.142722 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:42.143499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:42.143937 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:42.272425 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:42.279680 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8c93fecc-c1e0-46cb-af8f-c446209650ed tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1266 microversion: 2.1 time: 0.148865 Dec 08 11:44:42.280236 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 728/1435] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:42 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:43.297461 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:43.298167 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:43.304241 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:43.304698 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:43.305513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:43.305952 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:43.437743 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:43.444938 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1453 microversion: 2.1 time: 0.152013 Dec 08 11:44:43.445527 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 708/1436] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:43 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:43.460908 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:44:43.461570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:44:43.467731 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:43.468175 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:43.468945 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:43.469406 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:43.596458 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:44:43.603704 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d655e244-f0e1-4886-a996-c1af45a9f7b8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1453 microversion: 2.1 time: 0.146382 Dec 08 11:44:43.604252 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 729/1437] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:44:43 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:44:45.480593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:44:45.482685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:44:45.482685 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:44:45.490337 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:44:45.490809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:44:45.501977 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 service nova] Creating event network-changed:68177bf4-695b-4333-8e9c-95704a3235a4 for instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 on hv-cinder-81977 Dec 08 11:44:45.506895 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030102 Dec 08 11:44:45.507482 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 709/1438] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:44:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:46:11.177067 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:46:11.177687 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:46:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:46:30.656573 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:46:30.657181 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:46:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:46:59.516717 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [324d7371-a07c-4c12-a0be-5d1d12a6bc3e] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 08 11:46:59.520191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:46:59.520676 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:46:59.526525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:46:59.526971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:46:59.527742 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:46:59.528190 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:46:59.552207 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:46:59.627369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 204 len: 0 microversion: 2.1 time: 0.112460 Dec 08 11:46:59.627971 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 730/1439] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:46:59 2021] DELETE /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 08 11:46:59.634363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0540436-c46e-4637-b691-e757322894f7] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 08 11:46:59.638734 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:46:59.639426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:46:59.646130 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:46:59.646584 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:46:59.647365 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:46:59.647820 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:46:59.855442 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:46:59.863415 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-480e1c0b-a8cc-4942-b998-bc995471c2b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1577 microversion: 2.1 time: 0.230842 Dec 08 11:46:59.864017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 710/1440] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:46:59 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:47:00.880934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:00.881662 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:00.899288 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:00.899769 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:00.900559 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:00.901027 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:00.906365 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] [324d7371-a07c-4c12-a0be-5d1d12a6bc3e] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 38588. Dec 08 11:47:01.082957 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:01.090439 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-206b3b0d-e423-47cc-b65e-811eb17acd4f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1577 microversion: 2.1 time: 0.213480 Dec 08 11:47:01.090999 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 731/1441] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:00 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:02.107795 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:02.108583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:02.125236 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:02.125696 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:02.126499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:02.126941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:02.136175 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0540436-c46e-4637-b691-e757322894f7] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 38594. Dec 08 11:47:02.214757 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:02.223233 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-95a6dad8-6f03-413c-a04b-dac8ad97b525 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 200 len: 1509 microversion: 2.1 time: 0.118955 Dec 08 11:47:02.224065 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 711/1442] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:02 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 1509 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:02.230093 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-31599f96-a0a5-4847-8540-f3b24e9c71eb req-85e32145-d219-4bfb-8f18-fcbac5533935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "name": "network-vif-deleted", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:47:02.231576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:47:02.231576 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:47:02.239833 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-31599f96-a0a5-4847-8540-f3b24e9c71eb req-85e32145-d219-4bfb-8f18-fcbac5533935 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:02.240284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-31599f96-a0a5-4847-8540-f3b24e9c71eb req-85e32145-d219-4bfb-8f18-fcbac5533935 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:02.252331 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-31599f96-a0a5-4847-8540-f3b24e9c71eb req-85e32145-d219-4bfb-8f18-fcbac5533935 service nova] Creating event network-vif-deleted:68177bf4-695b-4333-8e9c-95704a3235a4 for instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 on hv-cinder-81977 Dec 08 11:47:02.258351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-31599f96-a0a5-4847-8540-f3b24e9c71eb req-85e32145-d219-4bfb-8f18-fcbac5533935 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110673 Dec 08 11:47:02.258351 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 732/1443] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:47:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:47:03.239612 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:03.240223 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:03.246513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:03.246970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:03.247755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:03.248197 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:03.261342 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] HTTP exception thrown: Instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 could not be found. Dec 08 11:47:03.261939 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Returning 404 to user: Instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:47:03.263030 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7e235c4c-085e-4728-8779-91d6f180a1fd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 404 len: 111 microversion: 2.1 time: 0.026927 Dec 08 11:47:03.263560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 712/1444] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:03 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:47:03.309321 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2100198322", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1445011975", "security_groups": [{"name": "tempest-secgroup-smoke-1598406315"}], "block_device_mapping_v2": [{"uuid": "6631c4d6-d3ed-4f92-bf48-fd91dee28c17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6155a6c-7a89-4b5b-b3cb-d77c93560254"}]}} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:47:03.419428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.network.neutron [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] validate_networks() for [('b6155a6c-7a89-4b5b-b3cb-d77c93560254', None, None, None, None, None)] {{(pid=117270) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:47:03.775004 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Flavor limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:47:03.775429 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Image limits 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:47:03.776009 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Flavor pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:47:03.776450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Image pref 0:0:0 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:47:03.776883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.virt.hardware [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:47:03.785658 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:03.786108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:03.786921 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:03.787359 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:03.803670 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for project 8cd51b040b7242d084a290de749786b8. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:47:03.807529 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.quota [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for user 60a663b7e4824df3af38eab2851d2d2c and project 8cd51b040b7242d084a290de749786b8. Resources: {'ram', 'cores', 'instances'} {{(pid=117270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:47:03.863163 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Going to run 1 instances... {{(pid=117270) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:47:03.865401 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6631c4d6-d3ed-4f92-bf48-fd91dee28c17',volume_size=None,volume_type=None)] {{(pid=117270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:47:03.982648 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677752 Dec 08 11:47:03.983287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 733/1445] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:47:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:47:03.993366 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-88568eaa-de3b-427b-9e79-f7d94979cc3e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:03.994201 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-88568eaa-de3b-427b-9e79-f7d94979cc3e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:04.045077 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-88568eaa-de3b-427b-9e79-f7d94979cc3e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:04.052273 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-88568eaa-de3b-427b-9e79-f7d94979cc3e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1095 microversion: 2.1 time: 0.062395 Dec 08 11:47:04.052831 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 713/1446] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:03 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:47:05.069399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:05.069988 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:05.078763 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:05.079253 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:05.080055 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:05.080508 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:05.144953 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:05.152720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-c8215b3e-928c-410d-ba90-889571ac9768 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1211 microversion: 2.1 time: 0.087443 Dec 08 11:47:05.153404 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 734/1447] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:05 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:06.170143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:06.171377 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:06.178459 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:06.178989 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:06.179877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:06.180409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:06.203081 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-f6884b3a-6344-4dd1-8acf-062f7847dce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:47:06.210944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:47:06.210944 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:47:06.230544 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-f6884b3a-6344-4dd1-8acf-062f7847dce0 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:06.231199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-f6884b3a-6344-4dd1-8acf-062f7847dce0 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:06.247812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-f6884b3a-6344-4dd1-8acf-062f7847dce0 service nova] Creating event network-changed:5c746524-978d-4ccf-9310-1c436d0934a6 for instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 on hv-cinder-81977 Dec 08 11:47:06.263828 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-f6884b3a-6344-4dd1-8acf-062f7847dce0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064181 Dec 08 11:47:06.264434 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 735/1448] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:47:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:47:06.399922 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:06.408689 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.241830 Dec 08 11:47:06.409769 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 714/1449] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:06 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:07.427369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:07.428015 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:07.434106 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:07.434563 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:07.435346 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:07.435789 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:07.563883 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:07.571179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.148356 Dec 08 11:47:07.571749 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 736/1450] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:07 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:08.587949 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:08.588567 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:08.595439 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:08.595899 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:08.596681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:08.597124 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:08.729484 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:08.737582 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-380e2f6d-17b4-48b7-83a3-542be17fe536 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.153234 Dec 08 11:47:08.738162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 715/1451] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:08 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:09.754616 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:09.755230 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:09.761997 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:09.762449 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:09.763499 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:09.763936 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:09.890526 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:09.897761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d3539d67-c75e-42a3-828c-395effd41ee5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.146825 Dec 08 11:47:09.898326 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 737/1452] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:09 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:10.914049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:10.914662 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:10.920823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:10.921310 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:10.922087 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:10.922520 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:11.052162 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:11.059322 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.148982 Dec 08 11:47:11.059967 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 716/1453] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:10 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:12.079031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:12.079885 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:12.086160 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:12.086603 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:12.087376 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:12.087817 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:12.215764 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:12.223562 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.148261 Dec 08 11:47:12.224124 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 738/1454] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:12 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:13.240099 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:13.240714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:13.246933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:13.247383 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:13.248157 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:13.248597 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:13.379151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:13.386436 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-79d05747-396f-4496-8e03-a02e1d2d281b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.150046 Dec 08 11:47:13.386991 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 717/1455] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:13 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:14.266163 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:47:14.267035 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:47:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:47:14.403713 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:14.404450 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:14.410312 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:14.410761 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:14.411537 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:14.411974 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:14.539760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:14.547627 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-84689976-ad82-4e30-8962-994d61f7667c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.148028 Dec 08 11:47:14.548191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 739/1456] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:14 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:15.564049 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:15.564573 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:15.570749 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:15.571200 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:15.571970 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:15.572406 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:15.700283 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:15.707954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-c2a50bc3-e166-458d-8095-816ecb7db11c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.147695 Dec 08 11:47:15.708505 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 718/1457] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:15 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:16.205050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-84b8a0f7-f60b-4b7a-97a1-2a8a320a93c7 req-77288828-95f3-42ea-9886-aaa2e099ccee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "name": "network-vif-plugged", "status": "completed", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:47:16.206577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:47:16.206577 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:47:16.214291 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-84b8a0f7-f60b-4b7a-97a1-2a8a320a93c7 req-77288828-95f3-42ea-9886-aaa2e099ccee service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:16.214581 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-84b8a0f7-f60b-4b7a-97a1-2a8a320a93c7 req-77288828-95f3-42ea-9886-aaa2e099ccee service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:16.225386 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-84b8a0f7-f60b-4b7a-97a1-2a8a320a93c7 req-77288828-95f3-42ea-9886-aaa2e099ccee service nova] Creating event network-vif-plugged:5c746524-978d-4ccf-9310-1c436d0934a6 for instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 on hv-cinder-81977 Dec 08 11:47:16.230677 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-84b8a0f7-f60b-4b7a-97a1-2a8a320a93c7 req-77288828-95f3-42ea-9886-aaa2e099ccee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029733 Dec 08 11:47:16.231251 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 740/1458] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:47:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:47:16.724792 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:16.725435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:16.731707 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:16.732165 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:16.732948 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:16.733432 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:16.859877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:16.867033 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1267 microversion: 2.1 time: 0.145901 Dec 08 11:47:16.867592 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 719/1459] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:16 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:17.884512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:17.885238 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:17.891570 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:17.892016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:17.892794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:17.893258 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:18.024634 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:18.032493 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-dcf2f22d-e61c-467c-9882-f9934cc52b68 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1454 microversion: 2.1 time: 0.152403 Dec 08 11:47:18.033050 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 741/1460] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:17 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:18.047957 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:47:18.048568 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:47:18.054785 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:18.055231 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:18.056009 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:18.056447 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:18.184640 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:47:18.191969 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a59c6b83-2f82-49b3-81d9-b3035836d945 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1454 microversion: 2.1 time: 0.147632 Dec 08 11:47:18.192537 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 720/1461] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:47:18 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:47:20.025927 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-16f6619b-450b-4309-8c97-5511583539ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:47:20.027541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:47:20.027541 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:47:20.034811 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-16f6619b-450b-4309-8c97-5511583539ac service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:47:20.035254 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-16f6619b-450b-4309-8c97-5511583539ac service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:47:20.045994 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-16f6619b-450b-4309-8c97-5511583539ac service nova] Creating event network-changed:5c746524-978d-4ccf-9310-1c436d0934a6 for instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 on hv-cinder-81977 Dec 08 11:47:20.051567 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-16f6619b-450b-4309-8c97-5511583539ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080950 Dec 08 11:47:20.052148 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 742/1462] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:47:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:47:57.866746 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:47:57.867465 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:47:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:49:21.313189 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-695691756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1445011975", "security_groups": [{"name": "tempest-secgroup-smoke-1598406315"}], "block_device_mapping_v2": [{"uuid": "6c31e216-6d34-481b-af81-5d397a9e201e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6155a6c-7a89-4b5b-b3cb-d77c93560254"}]}} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:49:21.425619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.network.neutron [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] validate_networks() for [('b6155a6c-7a89-4b5b-b3cb-d77c93560254', None, None, None, None, None)] {{(pid=117269) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 08 11:49:21.848688 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Flavor limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 08 11:49:21.849057 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Image limits 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 08 11:49:21.849563 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Flavor pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 08 11:49:21.849983 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Image pref 0:0:0 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 08 11:49:21.850430 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.virt.hardware [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 08 11:49:21.858849 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:21.859303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:21.860122 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:21.860570 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:21.876363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for project 8cd51b040b7242d084a290de749786b8. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 08 11:49:21.880417 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.quota [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Getting quotas for user 60a663b7e4824df3af38eab2851d2d2c and project 8cd51b040b7242d084a290de749786b8. Resources: {'ram', 'cores', 'instances'} {{(pid=117269) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 08 11:49:21.933748 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Going to run 1 instances... {{(pid=117269) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 08 11:49:21.935956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c31e216-6d34-481b-af81-5d397a9e201e',volume_size=None,volume_type=None)] {{(pid=117269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 08 11:49:22.056470 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [90eea11e-2fe4-4eca-b096-a2b474860e91] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 08 11:49:23.072495 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [90eea11e-2fe4-4eca-b096-a2b474860e91] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 38754. Dec 08 11:49:23.076203 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-a7a8cea2-bcf1-4e1b-963c-edd043132574 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.767613 Dec 08 11:49:23.076884 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 721/1463] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Dec 8 11:49:21 2021] POST /compute/v2.1/servers => generated 406 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 08 11:49:23.088203 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-089ed9f3-73c6-4681-be53-73e5f0a42508 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:23.088895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-089ed9f3-73c6-4681-be53-73e5f0a42508 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:23.142199 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-089ed9f3-73c6-4681-be53-73e5f0a42508 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:23.148502 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-089ed9f3-73c6-4681-be53-73e5f0a42508 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1094 microversion: 2.1 time: 0.065278 Dec 08 11:49:23.149046 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 743/1464] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:23 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:24.166257 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6dc49d2a-d762-48bb-b747-2de13196d96c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:24.166870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6dc49d2a-d762-48bb-b747-2de13196d96c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:24.217503 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6dc49d2a-d762-48bb-b747-2de13196d96c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:24.223954 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6dc49d2a-d762-48bb-b747-2de13196d96c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1094 microversion: 2.1 time: 0.061945 Dec 08 11:49:24.224506 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 722/1465] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:24 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:49:25.241016 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-32141920-67cd-4821-a2eb-765e67146fc3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:25.241661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-32141920-67cd-4821-a2eb-765e67146fc3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:25.297982 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-32141920-67cd-4821-a2eb-765e67146fc3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:25.304744 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-32141920-67cd-4821-a2eb-765e67146fc3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1094 microversion: 2.1 time: 0.067576 Dec 08 11:49:25.305611 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 744/1466] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:25 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:26.321809 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-90d507a8-9c4e-4031-82d0-98c834a9dbb8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:26.322344 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-90d507a8-9c4e-4031-82d0-98c834a9dbb8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:26.380982 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-90d507a8-9c4e-4031-82d0-98c834a9dbb8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:26.387618 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-90d507a8-9c4e-4031-82d0-98c834a9dbb8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1094 microversion: 2.1 time: 0.069399 Dec 08 11:49:26.388214 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 723/1467] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:26 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:27.405354 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:27.405896 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:27.412461 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:27.412918 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:27.413735 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:27.414178 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:27.471949 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:27.479825 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-108bb857-ec68-4cd8-8b0f-d553f78024a0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1144 microversion: 2.1 time: 0.078870 Dec 08 11:49:27.480399 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 745/1468] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:27 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:28.503751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:28.504542 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:28.511195 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:28.511642 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:28.512699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:28.513136 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:28.609302 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:28.616877 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2e963a87-9805-43b3-a66a-9f880e0f4a9c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1210 microversion: 2.1 time: 0.123660 Dec 08 11:49:28.625281 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 724/1469] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:28 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:29.410100 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6883dda0-141a-4066-a677-829528fa1797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]} {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:49:29.411504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:49:29.411504 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: warnings.warn(msg) Dec 08 11:49:29.418659 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6883dda0-141a-4066-a677-829528fa1797 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:29.419107 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6883dda0-141a-4066-a677-829528fa1797 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:29.436284 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.compute.server_external_events [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6883dda0-141a-4066-a677-829528fa1797 service nova] Creating event network-changed:b00da941-b960-42cc-9123-d755131a0179 for instance 41844874-f1c6-4195-85ed-49cb1f149ae8 on hv-cinder-81977 Dec 08 11:49:29.442512 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6883dda0-141a-4066-a677-829528fa1797 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036037 Dec 08 11:49:29.443412 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 746/1470] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:49:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:49:29.634714 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:29.635409 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:29.642385 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:29.642838 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:29.643681 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:29.644070 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:29.856855 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:29.864699 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-234e0997-0484-4b68-a676-4e283fca5436 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.233712 Dec 08 11:49:29.865321 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 725/1471] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:29 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:30.883348 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:30.884036 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:30.890847 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:30.891292 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:30.892063 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:30.892495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:31.021952 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:31.029813 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-e2ffc3dc-da48-4780-ace6-b7211f70c915 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.150835 Dec 08 11:49:31.030301 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 747/1472] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:30 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:32.046151 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:32.046767 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:32.053018 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:32.053500 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:32.054284 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:32.054726 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:32.188268 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:32.195443 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-6f0c08aa-7876-4bb4-8019-df13dd403320 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.152987 Dec 08 11:49:32.196017 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 726/1473] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:32 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:33.211962 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:33.212569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:33.218874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:33.219316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:33.220112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:33.220542 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:33.349135 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:33.356270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-76f8570f-5ed7-4691-a0ce-971b17201602 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.147951 Dec 08 11:49:33.356820 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 748/1474] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:33 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:34.373555 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:34.374087 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:34.380343 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:34.380797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:34.381609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:34.382054 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:34.512620 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:34.520327 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.150524 Dec 08 11:49:34.520892 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 727/1475] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:34 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:35.537334 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:35.537942 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:35.545293 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:35.546102 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:35.547484 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:35.548316 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:35.685495 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:35.694310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-51e10952-ff09-4542-a8e5-181c97eeb2e3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.160706 Dec 08 11:49:35.694874 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 749/1476] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:35 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:36.711013 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:36.711613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:36.718650 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:36.719094 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:36.719870 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:36.720303 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:36.847499 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:36.854744 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.147525 Dec 08 11:49:36.855306 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 728/1477] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:36 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:37.871204 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:37.871812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:37.878322 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:37.878775 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:37.879555 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:37.879991 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:38.022191 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:38.029951 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-350cdd3e-0278-4111-bf9e-b4083c0aa14b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.162352 Dec 08 11:49:38.030510 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 750/1478] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:37 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:39.046045 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:39.046600 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:39.052834 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:39.053326 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:39.054111 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:39.054550 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:39.183481 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:39.191265 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.149488 Dec 08 11:49:39.191824 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 729/1479] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:39 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:40.208208 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:40.208812 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:40.215060 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:40.215506 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:40.216278 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:40.216711 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:40.351571 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:40.359268 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-02cf160f-01e2-492b-a9ae-c817afc24bef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.154160 Dec 08 11:49:40.359830 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 751/1480] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:40 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:40.914147 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "name": "network-vif-plugged", "status": "completed", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:49:40.915728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:49:40.915728 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:49:40.923029 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:40.923583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:40.938052 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] Creating event network-vif-plugged:b00da941-b960-42cc-9123-d755131a0179 for instance 41844874-f1c6-4195-85ed-49cb1f149ae8 on hv-cinder-81977 Dec 08 11:49:40.941579 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: ERROR oslo.messaging._drivers.impl_rabbit [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] [aa3e495c-29c6-4377-a159-a7ed4ccf08ac] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 08 11:49:41.376260 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:41.376794 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:41.383091 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:41.383546 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:41.384324 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:41.384760 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:41.513130 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:41.520315 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-370138ae-678b-4747-bff2-3b0b35857b15 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.148328 Dec 08 11:49:41.520881 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 752/1481] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:41 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:49:41.958764 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] [aa3e495c-29c6-4377-a159-a7ed4ccf08ac] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 38826. Dec 08 11:49:41.962119 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-f8e93538-f031-4062-bf14-9b7ca029243e req-f1a28336-4106-46ad-a1ec-15107d44c469 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.051731 Dec 08 11:49:41.962741 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 730/1482] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:49:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:49:42.536934 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:42.537485 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:42.543703 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:42.544158 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:42.544935 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:42.545405 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:42.676128 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:42.683217 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d3322825-878e-428b-babe-6bae2fc597ad tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1266 microversion: 2.1 time: 0.149981 Dec 08 11:49:42.683777 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 753/1483] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:42 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:43.700510 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:43.701235 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:43.707890 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:43.708347 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:43.709134 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:43.709609 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:43.838732 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:43.846058 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1454 microversion: 2.1 time: 0.149991 Dec 08 11:49:43.846613 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 731/1484] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:43 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:43.861536 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:49:43.862154 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:49:43.868369 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:43.868821 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:43.869629 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:43.870067 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:44.002525 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:49:44.009838 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-d584b4da-0df8-46db-a181-c28a9156863a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1454 microversion: 2.1 time: 0.151906 Dec 08 11:49:44.010397 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 754/1485] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:49:43 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:49:45.865115 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:49:45.867025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:49:45.867025 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:49:45.874504 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:49:45.874979 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:49:45.885827 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc service nova] Creating event network-changed:b00da941-b960-42cc-9123-d755131a0179 for instance 41844874-f1c6-4195-85ed-49cb1f149ae8 on hv-cinder-81977 Dec 08 11:49:45.892560 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030885 Dec 08 11:49:45.893137 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 732/1486] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:50:34.286634 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:50:34.287375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:50:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:51:17.897227 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:51:17.897839 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:51:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:51:30.675661 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 08 11:51:30.676440 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:51:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:51:49.357021 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0540436-c46e-4637-b691-e757322894f7] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 08 11:51:49.361665 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-02b57148-5ac7-402e-be59-c6e9442635be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:51:49.363979 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:49.364569 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:49.366113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:51:49.366113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:51:49.371371 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:49.372119 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:49.372978 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:49.373143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-02b57148-5ac7-402e-be59-c6e9442635be service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:49.373605 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:49.373719 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-02b57148-5ac7-402e-be59-c6e9442635be service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:49.385190 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-02b57148-5ac7-402e-be59-c6e9442635be service nova] Creating event network-changed:b00da941-b960-42cc-9123-d755131a0179 for instance 41844874-f1c6-4195-85ed-49cb1f149ae8 on hv-cinder-81977 Dec 08 11:51:49.390760 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-02b57148-5ac7-402e-be59-c6e9442635be service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035993 Dec 08 11:51:49.391790 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 733/1487] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 08 11:51:49.401664 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:51:49.484031 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-390c168c-cb29-4ed2-8b28-92e0e4abb667 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 204 len: 0 microversion: 2.1 time: 0.132157 Dec 08 11:51:49.484591 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 755/1488] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:51:49 2021] DELETE /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:51:49.494498 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:49.495553 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:49.502363 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:49.502823 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:49.503619 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:49.504061 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:49.724433 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:51:49.731863 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-33a11f91-3c7f-4a33-b27a-a482523a75da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1578 microversion: 2.1 time: 0.241833 Dec 08 11:51:49.732426 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 734/1489] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:49 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:51:50.749356 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:50.750056 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:50.756972 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:50.757462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:50.758247 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:50.758688 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:50.895950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:51:50.903152 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1460 microversion: 2.1 time: 0.157864 Dec 08 11:51:50.903707 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 756/1490] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:50 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1460 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:51:51.715314 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-d170a51a-d59e-4153-a1c0-ca1f0b80469d req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "name": "network-vif-deleted", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:51:51.717590 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:51:51.717590 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:51:51.743064 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0540436-c46e-4637-b691-e757322894f7] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 38892. Dec 08 11:51:51.747941 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-d170a51a-d59e-4153-a1c0-ca1f0b80469d req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:51.748387 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-d170a51a-d59e-4153-a1c0-ca1f0b80469d req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:51.759956 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-d170a51a-d59e-4153-a1c0-ca1f0b80469d req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 service nova] Creating event network-vif-deleted:b00da941-b960-42cc-9123-d755131a0179 for instance 41844874-f1c6-4195-85ed-49cb1f149ae8 on hv-cinder-81977 Dec 08 11:51:51.765593 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-d170a51a-d59e-4153-a1c0-ca1f0b80469d req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054063 Dec 08 11:51:51.766168 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 735/1491] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:51:51.920382 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:51.920895 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:51.927797 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:51.928283 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:51.929030 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:51.929494 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:51.993688 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:51:52.002006 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-eea31696-1bd9-4507-8047-0f4bc570a552 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 200 len: 1225 microversion: 2.1 time: 0.085230 Dec 08 11:51:52.002858 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 757/1492] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:51 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:51:53.019071 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:53.019766 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 41844874-f1c6-4195-85ed-49cb1f149ae8] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:53.026287 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:53.026738 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:53.027513 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:53.027950 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:53.040535 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] HTTP exception thrown: Instance 41844874-f1c6-4195-85ed-49cb1f149ae8 could not be found. Dec 08 11:51:53.041112 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Returning 404 to user: Instance 41844874-f1c6-4195-85ed-49cb1f149ae8 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:51:53.041933 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-feea33b0-d4f1-45c8-8a9f-e4a2e6412460 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8" status: 404 len: 111 microversion: 2.1 time: 0.026855 Dec 08 11:51:53.042448 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 736/1493] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:53 2021] GET /compute/v2.1/servers/41844874-f1c6-4195-85ed-49cb1f149ae8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:51:56.356270 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:56.356793 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:56.363287 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:56.364187 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:56.364583 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-244426fb-cd55-4529-8b43-6f0c6307e444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:51:56.365037 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:56.365463 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:56.366186 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:51:56.366186 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:51:56.373676 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-244426fb-cd55-4529-8b43-6f0c6307e444 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:56.374003 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-244426fb-cd55-4529-8b43-6f0c6307e444 service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:56.385541 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-244426fb-cd55-4529-8b43-6f0c6307e444 service nova] Creating event network-changed:5c746524-978d-4ccf-9310-1c436d0934a6 for instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 on hv-cinder-81977 Dec 08 11:51:56.391356 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-244426fb-cd55-4529-8b43-6f0c6307e444 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030005 Dec 08 11:51:56.393335 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Going to try to terminate instance {{(pid=117270) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 08 11:51:56.395217 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 737/1494] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:51:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:51:56.480277 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-9d0ca8ad-3315-419c-804a-217ef08d99c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 204 len: 0 microversion: 2.1 time: 0.127594 Dec 08 11:51:56.485469 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 758/1495] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:51:56 2021] DELETE /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 08 11:51:56.490663 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:56.491395 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:56.498143 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:56.504815 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:56.506282 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:56.506755 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:56.723878 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.policy [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117269) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:51:56.731865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-1d074853-9565-4760-973b-47412b1c1bb5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1578 microversion: 2.1 time: 0.245257 Dec 08 11:51:56.732980 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 738/1496] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:56 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 08 11:51:57.751108 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:57.751720 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:57.757918 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:57.758368 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:57.759179 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:57.759620 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:57.888933 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:51:57.896865 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1460 microversion: 2.1 time: 0.149938 Dec 08 11:51:57.897462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 759/1497] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:57 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:51:58.664797 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [req-729f19ff-fb93-4cb4-b9b4-85c7291e8305 req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "name": "network-vif-deleted", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]} {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 08 11:51:58.666981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 08 11:51:58.666981 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: warnings.warn(msg) Dec 08 11:51:58.674516 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-729f19ff-fb93-4cb4-b9b4-85c7291e8305 req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:58.675031 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [req-729f19ff-fb93-4cb4-b9b4-85c7291e8305 req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e service nova] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:58.687750 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.compute.server_external_events [req-729f19ff-fb93-4cb4-b9b4-85c7291e8305 req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e service nova] Creating event network-vif-deleted:5c746524-978d-4ccf-9310-1c436d0934a6 for instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 on hv-cinder-81977 Dec 08 11:51:58.693350 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [req-729f19ff-fb93-4cb4-b9b4-85c7291e8305 req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Dec 08 11:51:58.693934 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 739/1498] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Dec 8 11:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 08 11:51:58.913788 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:51:58.914379 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:51:58.920984 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:58.921462 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:58.922259 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:58.923220 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:58.956942 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:51:58.957773 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:51:58.958261 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.objects.instance [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lazy-loading 'fault' on Instance uuid 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 {{(pid=117270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 08 11:51:59.000074 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.policy [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a663b7e4824df3af38eab2851d2d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cd51b040b7242d084a290de749786b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117270) authorize /opt/stack/nova/nova/policy.py:199}} Dec 08 11:51:59.008304 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-bc6e7377-7b13-4231-a028-88751719a461 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 200 len: 1231 microversion: 2.1 time: 0.098486 Dec 08 11:51:59.008868 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 760/1499] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:51:58 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 08 11:52:00.026412 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:52:00.027140 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 11f57812-dea3-4a2d-9c1e-8b827a2c5be3] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:52:00.034101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:52:00.034101 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:52:00.035317 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:52:00.035751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:52:00.048345 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] HTTP exception thrown: Instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 could not be found. Dec 08 11:52:00.048923 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Returning 404 to user: Instance 11f57812-dea3-4a2d-9c1e-8b827a2c5be3 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:52:00.049751 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-25d446a4-531f-4097-aaba-8b98892e6b8a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3" status: 404 len: 111 microversion: 2.1 time: 0.027754 Dec 08 11:52:00.050275 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 740/1500] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:52:00 2021] GET /compute/v2.1/servers/11f57812-dea3-4a2d-9c1e-8b827a2c5be3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:52:00.489428 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:52:00.489922 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.compute.api [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117270) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:52:00.496084 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:52:00.496535 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:52:00.497353 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:52:00.497796 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG oslo_concurrency.lockutils [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:52:00.510474 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.wsgi [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] HTTP exception thrown: Instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 could not be found. Dec 08 11:52:00.511051 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Returning 404 to user: Instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 could not be found. {{(pid=117270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:52:00.512112 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-350c7ee2-db61-4a8e-a064-0bcf5a893a21 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 404 len: 111 microversion: 2.1 time: 0.026150 Dec 08 11:52:00.512621 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 761/1501] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Dec 8 11:52:00 2021] DELETE /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:52:00.520799 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '>' {{(pid=117269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:52:00.521435 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.compute.api [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] [instance: 8bc862ae-0de5-4018-9e1c-6e8898557c37] Fetching instance by UUID {{(pid=117269) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 08 11:52:00.527113 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:52:00.527558 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:52:00.528358 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:52:00.528789 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG oslo_concurrency.lockutils [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Lock "d7033496-1996-4048-927c-ede6e1628ed2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:52:00.541989 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.wsgi [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] HTTP exception thrown: Instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 could not be found. Dec 08 11:52:00.542564 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: DEBUG nova.api.openstack.wsgi [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Returning 404 to user: Instance 8bc862ae-0de5-4018-9e1c-6e8898557c37 could not be found. {{(pid=117269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 08 11:52:00.543361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO nova.api.openstack.requestlog [None req-54e85628-d554-4c35-9833-b98881556f43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37" status: 404 len: 111 microversion: 2.1 time: 0.026236 Dec 08 11:52:00.543865 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: [pid: 117269|app: 0|req: 741/1502] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Dec 8 11:52:00 2021] GET /compute/v2.1/servers/8bc862ae-0de5-4018-9e1c-6e8898557c37 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 08 11:52:01.814448 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: DEBUG nova.api.openstack.wsgi [None req-351d400a-68f9-478d-aa27-1e02a8df5965 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling method '.version_select at 0x7f1fa656d4c0>' {{(pid=117270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 08 11:52:01.837736 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO nova.api.openstack.requestlog [None req-351d400a-68f9-478d-aa27-1e02a8df5965 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1445011975" status: 202 len: 0 microversion: 2.1 time: 0.028212 Dec 08 11:52:01.838310 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: [pid: 117270|app: 0|req: 762/1503] 10.222.0.66 () {58 vars in 1262 bytes} [Wed Dec 8 11:52:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1445011975 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 08 11:52:51.255040 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:52:51.255727 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:52:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:53:54.304375 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:53:54.304961 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:53:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:54:31.199594 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:54:31.200291 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:54:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:54:37.914950 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:54:37.915599 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:54:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:54:47.224851 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:54:47.225427 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:54:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:54:50.692532 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:54:50.693105 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:54:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:56:11.272372 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:56:11.273033 dv-cinder-819778-3-iscsi devstack@n-api.service[117270]: Wed Dec 8 11:56:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 08 11:57:14.321783 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 08 11:57:14.322361 dv-cinder-819778-3-iscsi devstack@n-api.service[117269]: Wed Dec 8 11:57:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!